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I-  INTRODUCTION 

This  thesis  concentrates  on  the  Marine  Corps  Development 
and  Education  Command,  Research  and  Development  Program 
Prioritization  Process.  The  process  was  originally  proposed 
to  assist  in  developing  the  Marine  Corps'  input  to  the 
Navy's  Research,  Development,  Test  and  Evaluation  (FDTSE,N) 
Program  Objective  Memorandum  (POM) .  The  process  combines 
subjective  evaluations  of  the  Marine  Corps'  identified 
mission  deficiencies  and  proposed  RDT&E  programs,  and 
produces  a  RDT&E  program  rank  ordering  according  to  mission 
deficiency  accomplishment  importance.  The  Department  of 
Defense  acquisition  system  is  reviewed  as  it  establishes  the 
base  for  Marine  Corps  RDT&E  program  acquisition.  Review  of 
current  acquisition  procedures  reveal  that  analytic  models 
are  used  in  support  of  the  Procurement  Marine  Corps  (P^C) 
POM  tut  net  for  Marine  Corps  RET&E, N  POM  input. 

The  literature  concerning  research  and  development 
program  selection  models  is  reviewed.  The  review  shows  that 
a  wide  range  of  program  selection  models  are  proposed  and 
accepted  by  industry.  The  literature  lends  credence  to  the 
MCDEC  process  by  allowing  process  classification  with  the 
majority  of  industry  accepted  models.  Mathematical  program- 
ming enhancement  to  this  classification  is  suggested  by  the 
literature  and  is  illustrated  in  this  investigation.  Linear 
programming  formulations  are  used  to  duplicate  the  fCDEC 
process  and  suggest  mathematical  programming  advantages 
under  budget  reduction  conditions.  A  MCDEC  produced  process 
test  data  set  is  used  to  further  illustrate  the  linear 
programming  f or mulations.  A  second  linear  programming 
approach  is  suggested  which  concentrates  on  the  number  of 
mission   deficiencies   accomplished  rather   than   the   RDT&E 


programs  and   presents  a  favorable  program   selection  model 
alternative  for  the  sample  data  set. 

Further  investigation  is  required  to  establish  ether 
possible  alternatives  suggested  by  the  literature  and  for 
the  iiplemertation  of  a  Marine  Corps  RDT&E  program  selection 
process.  Further  consideration  of  the  costs  associated  with 
software,  data  collection,  and  manpower  requirements  will  be 
necessary  as  well  as  comparing  these  costs  with  the  benefits 
received  frcm  a  process  implementation. 
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II.     EACKGEOOND 

A.   IMTECDOCTION 

The  Planning/  P  icgramming,  and  Budgeting  System  (PPES) 
structures  the  defense  systems  acquisition  procedure  within 
the  Eepartment  of  Defense  (DoD) .  This  structure  is  a  step- 
wise review  and  decision  process  conducted  at  various  levels 
in  the  EoD  hierarchy.  The  process  translates  validated 
defense  mission  needs  into  budget  allocations  which  fund 
programs  that  are  expected  to  overcome  the  stated  needs.  In 
this  thesis  the  hierarchical  level  of  concern  descends  from 
the  Office  of  the  Secretary  of  Defense  (OSD),  through  the 
Department  of  the  Navy  (DoN),  to  the  Marine  Corps  and  the 
Navy.  The  analysis  concentrates  on  the  initial  PPBS  steps 
taken  at  this  level,  and  specifically  the  Research, 
Development,  Test,  ^and  Evaluation  (EDT&E)  acquisition 
program  pricritizatici  and  funding  profile  process  used  by 
the  Marine  Corps. 

E.   SYSTEMS  ACQDISIT1CN  IN  DSMC 

1  •   Eesponsibili ties 

Specific  resj:  onsib  ilities  are  assigned  the  Marine 
Corps  by  law.1  Figure  2.1  depicts  three  levels  of  RETSE  and 
systems  acquisition  management  that  assist  in  accomplishing 
these  responsibilities.  The  RDT&E  and  system  acguisition 
responsibilities   stated  in   MCO   5000. 10A   [Ref.  1]   first 


*The  National  Security  Act  of  1947,  as  amended,  and 
subsequent  DoD  and  SecNav  directives  assign  the  Marine  Corps 
general  and  specific  responsibilities  for  developing  the 
tactics,  techniques,  and  eguipment  used  by  amphibious 
landing  forces.  The  Marine  Corps  is  directed  to  coordinate 
and  request  appropriate  assistance  for  this  development  with 
the  Navy  and  other  military  services. 
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designates  the  Assistant  Commandant  of  the  Marine  Corps 
(ACMC)  as  the  acquisition  executive  and  then  assigns  him  the 
responsitility  for  overall  integration  and  unification  of 
the  management  process.  The  Deputy  Chief  of  Staff  (CC/S) 
for  Eesearch,  Development,  and  Studies  (RDSS)  assists  the 
ACMC  by  acting  as  the  coordinator  of  staff  activities 
involved  in  EDTSE  and  system  acquisition  from  program  initi- 
ation to  approval  for  service  use.  The  Commanding  General, 
Marine  Corps  Development  and  Education  Command  (CG,  MCDEC) 
is  the  field  representative  of  the  Commandant  of  the  Marine 
Corps  (CMC)  in  EDTSE  efforts  and  is  responsible  for  the 
field  execution  and  coordination  of  Marine  Corps'  EDTSE 
activities  to  support  the  systems  acquisition.  This 
includes  coordinating  Marine  Corps  support  needs  with  ether 
nilitary  services,  as  well  as  reporting  on  EDTSE  efforts  of 
ether  services,  agencies,  and  governments. 


■ 

AcoultHlon 
E»*cutlv« 

1 

oc/s  oo*s 

CC  KCOCC 

Soootcr* 

Figure  2.  1    EDTSE  and  System  Acquisition  levels. 

The  deputy  chiefs  of  staff  or  directors  of  major 
staff  offices  at  Headquarters  Marine  Corps  (HQMC)  are 
assigned  as  program  sponsors  for  specific  Marine  Corps 
mission  areas  and  are  intimately  involved  in  the  acquisition 
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process.  The  program  sponsors  are  responsible  for  the 
continuous  analysis  cf  their  mission  areas  and  the  overall 
planning,  coordination,  and  direction  of  related  program 
acquisitions.  These  responsibilities  are  accomplished  in 
coordination  with  DC/S  RD&S  and  CG,  MCDEC. 

2  -   Ana lisis  of  Needs 

The  directed  continual  analysis  of  mission  areas  by 
the  program  sponsors,  with  input  from  the  Fleet  Marine  Eorce 
(FMF)  ,  initially  identifies  operational  mission  needs. 
These  needs,  or  equivaiently  mission  deficiencies,  are 
formally  refined,  additional  needs  identified,  and  related 
new  concepts  formulated  by  Mission  Area  Analysis  (MAA)  . 
MAAs  are  assessments  of  current  or  projected  Marine  Corps 
capabilities  within  the  specific  mission  areas  and  elements 
listed  in  Table  I  and  are  conducted  by  HQMC  or  MCDEC  staff 
sections  in  coordination  with  the  program  sponsors  and  CG, 
MCDEC.  The  MAA  details  the  mission  elements  of  Table  I  into 
general  operational  nissions  and  then  further  into  specific 
operational  missions.  These  specific  missions  can  then  be 
matched  against  specific  resources  for  their  accomplishment. 
If  no  resources  are  available  then  a  deficiency  is  identi- 
fied and  recommendations  for  overcoming  the  deficiency  are 
presented.  SECNAVINST  5000- 1A  [Ref.  2]  and  "A  Guide  for  the 
Ferfcrmance  of  USMC  Mission  Area  Analysis"  [Ref.  3]  detail 
the  requirements  and  methodology  of  conducting  MAAs.  Each 
identified  deficiency  is  formulated  into  a  Justification  for 
Major  System  New  Start  (JMSNS)  or  a  Required  Operational 
Capability  (ROC)  according  to  the  Acquisition  Category 
(ACAT) .  This  documentation  then  forms  the  basis  for  initi- 
ating RDTSE  funding  and  program  acquisition. 
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TABLE    I 
Marine  Corps   Mission   Areas   and   Elements 

AREA       ELEMENT  TITLE 

2  10  Land    Warfare 

21  1  Close    Combat 

212  Fire  Support 

213  Ground  Air  Defense 

21 4  Mine  Warfare 

215  Land  Combat  Support 

216  Land  Combat  Service  Support 

220  Air  Warfare 

221  Counter  Air 

222  Offensive  Air 

224  Defense  Suppression 

225  Air  Warfare  Support 

230  Naval    Warfare 

235  Amphibious   Warfare 

240  Tactical    Nuclear    Warfare 

243  Defensive    Tactical    N-Warfare 

250  Theater   and   Tactical   C3I 

252  Tactical    Command    Control 
and    Intelligence      Systems 

255  Surveillance,    Reconnaissance    S 
Targets    for   Acquisition 

256  Tactical    Communications 

257  Electronic   Warfare    &   Counter    C3I 

260  Mobility 

26  1  Airlift 

262  Sealift      " 

264  Refueling 

320  Defense    Wide   C3I    Support 

32  1  Navigation    &    Position    Fixing 

322  Support    and    Base    Communication 

32  4  COM  5  EC 

430  Non-System   Training    Devices 

43  1  Training    Devices/Simulators 

450  Test    and    Evaluation    Support 

453  Joint   Test    and    Evaluation 

454  Other   Test   and    Evaluation 

460  International   Cooperative    RDT6E 

46  1  Standardization   5    Interoperability 

470  Management    Support 

47  1  General    Management    Support 

520  Exploratory  Development 

521  Electronic  &  Physical  Sciences 

522  Environmental  S  Life  Sciences 

523  Engineering  Technology 
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C.       BEVIIfl    2ND    DECISION    PROCESS 
1  .      milestones 

Four  formal  decision  points  are  established  within 
the  program  acquisition  process  and  are  designated  mile- 
stones 0,  I,  II,  and  III.  Positive  approval  is  necessary  at 
each  milestone  for  passage  of  a  program  from  conception  to 
operational  deployment.  Milestone  0  signifies  program  initi- 
ation en  approval  of  a  JMSNS  cr  a  ROC.  A  favorable  mile- 
stone I  decision  gives  the  approval  to  demonstrate  selected 
alternatives.  Then  a  milestone  II  approval  authorizes  full 
scale  development  and  limited  production  for  operational 
testing  and  evaluation.  Finally,  milestone  III  passage  is 
necessary  fcr  production  release  and  approval  for  service 
use.  Marine  Corps'  input  to  the  RDTS2,N  Program  Objective 
Memorandum  (POM)  is  required  throughout  this  process  until 
milestone  III,  after  which  acquisition  funding  comes  under 
the    Procurement    Marine   Corps    (PMC)     POM. 

2 .      Phases 

Ihe  review  steps  of  the  acquisition  process,  shewn 
in  Figure  2.2  ,  are  described  as  phases  separated  by  the 
decision  milestones.  The  initial  reviews  and  analysis 
previously  discussed  are  included  in  the  first,  or  research 
phase.  Studies  and  MAAs  conducted  in  this  phase  identify 
mission  deficiencies  that,  in  turn,  generate  JMSNSs  cr  FOCs. 
Ihese  documents  assess  the  projected  threat,  state  the 
mission  element  deficiency,  identify  the  existing  DCD  capa- 
bilities, assess  the  impact  of  not  acquiring  or  maintaining 
the  capabilities,  and  finally  provide  a  program  flar.  to 
identify  and  explore  competitive  alternatives. 

Approval  of  the  JMSNS  or  ROC  at  milestone  0  moves 
the  process  from  the  research  phase  to  the  program  initia- 
tion phase.    The  objectives  of   this  phase   include  further 
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Figure  2.2    Marine  Corps  Acquisition  Process  Flow  Chart. 
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program  study  and  th€  development  of  a  technological  base  to 
support  the  program  through  the  remaining  reviews  and  deci- 
sions. Tasks  necessary  to  accomplish  these  objectives  are 
program  cost  analysis,  operational  effectiveness  studies, 
alternative  identification,  technical  and  economical  feasi- 
bility studies,  risk  determination,  and  further  concept  and 
threat  analysis.  The  primary  documents  produced  during  this 
phase  are  the  System  Concept  Paper  {SC?)  for  major  programs 
or  the  Decision  Coordinating  Paper  (DCP)  for  less-than-iia jor 
programs.  These  documents  summarize  the  program  development 
to  date  and  address  mission  element  need,  technology  assess- 
ment, program  description,  management  plan,  and  acquisition 
logistics  and  manpower. 

Approval  of  the  SCP  or  DC?  at  milestone  I  starts  the 
demonstration  and  validation  phase.  Viable  alternative 
systems  and  critical  subsystems  are  subjected  to  competitive 
demonstrations  during  this  phase.  Tasks  accomplished  in 
conjucticn  with  this  phase  include  reviews  of  acquisition 
strategies,  logistics,  manpower  and  training  planning,  as 
well  as  the  preparation  of  the  test  and  evaluation  master 
plan  (TEMP).  Major  consideration  is  given  to  the  thorough 
understanding  of  the  operational  need  and  the  evaluation  of 
all  alternatives.  Each  alternative's  unit  cost  goal,  life 
cycle  cost,  technical  feasibility,  and  economic  realism  is 
reviewed.  When  the  demonstration  and  validation  phase 
produces  sufficient  evidence  that  the  preferred  system  can 
fulfill  all  necessary  capabilities,  and  that  technology 
exists  to  produce  the  system,  the  program  sponsor  recommends 
approval  at  milestone  II. 

A  successfully  passed  milestone  II  initiates  the 
full  scale  development  (FSD)  phase.  This  phase  ensures  that 
the  engineering  and  production  design,  test  and  evaluaticn, 
personnel  and  training,  and  the  integrated  logistic  support 
planning  are  completed  prior  to  moving  into  production.  Upon 
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completion  of  all  research  aid  development  through  this 
phase/  the  approval  for  service  use  is  given  at  milestone 
III.  This  decision  tc  proceed  starts  the  production  and 
deployment  phase  and  also  designates  the  shifts  of  funding 
from  EDTSE,N  to  PMC  as  well  as  the  coordination  responsi- 
bility from  the  DC/S  RDSS  to  the  Deputy  Chief  of  Staff  for 
Installations   and   Logistics. 

3 •      Categories 

All  mission-essential  acquisition  programs  in  the 
Marine  Corps  are  classified  as  either  a  major  or  less-than- 
major    urogram.  These   two      categories    imply      the    level      at 

which  a  nilestone  decision  is  made.  Major  programs  are 
designated  according  to  their  funding  level  and  ether 
criteria,  and  may  be  assigned  by  the  Secretary  of  Defense 
(SecDef)  ,  Secretary  of  the  Navy  (SecNav)  ,  or  the  Commandant 
of      the         Marine      Coifs         (CMC).  Department         of      Defense 

Instruction  5000.2  [Bef.  4  ],  SECNAVINST  5000.  1A  [Eef.  2], 
and  MCO  5000. 10A  [Eef.  1]  list  major  program  criteria  used 
in  these  designations.  Less- than- ma jor  programs  are  simply 
all  other  mission-essential  acquisition  programs  not  desig- 
nated   as    major    program's. 

1  •       Eeview    C cuncils 

The  level  of  hierarchy  that  designates  a  program  as 
major  also  becomes  the  final  decision  authority  for  that 
program  at  milestones  I,  II,  and  III.  The  decision  aakers 
are  supported  by  recommendations  developed  by  the  appro- 
priate review  councils  which  convene  for  these  three  irile- 
stones.  The      Defense    System      Acquisition      Eeview      Council 

(DSAflC)  and  the  Department  of  the  Navy  System  Acquisition 
Eeview  Council  (DNSABC)  provide  program  recommendations  to 
the  SecDef  and  the  SecNav,  respectively.  Similarly,  the 
Marine      Corps      System      Acquisition      Review      Council       (MSAEC) 
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supports  the  CMC  or,  all  major  programs  including  these 
subject  to  higher  review.  The  MSAEC  consists  of  a  hoard  of 
general  officers,  which  is  chaired  by  the  ACMC  and  includes 
the  CG,  MCEEC,  DC/S  EESS,  and  other  major  HQMC  staff  chiefs 
and  directors.  This  council  receives  a  comprehensive  review 
cf  the  research  and  development  concerning  the  acquisition 
program  and  formulates  recommendations  for  submission  tc  the 
CMC. 

The  less-than-major  programs  undergo  a  siirilar 
review  process  by  an  In  Process  Review  (IPS)  Committee.  This 
committee  is  chaired  by  the  DC/S  SDSS  and  has  representation 
from  all  major  HQMC  staff  and  the  CG,  MCDEC.  The  ACMC  is  the 
decision  authority  fcr  less-than-major  programs,  and  the  IPR 
committee  submits  recemmendatiens  to  the  ACMC  for  the  acqui- 
sition   program    decision. 

E.        OSMC    BDTSE    PEOGBABMING    AND    BUDGETING 

All      research,         development,         testing,         and      analysis 
described        in  this        chapter        depend  critically        on 

Congressionally-approved  allocations.  The  estimation  and 
submission  cf  funding  requests  are  coordinated  by  the  DC/S 
ED& S  for  each  fiscal  year,  and  this  process  involves  all 
Chiefs  cf  Staff  and  Directors  at  HQMC.  Initially  each 
program  sponsor  must  submit  a  prioritized  listing  and  accu- 
rate funding  estimate  of  his  respective  acquisition 
programs.  The  programs  are  then  combined  and  subjectively 
prioritized  and  evaluated  through  a  sequence  of  committees. 
The  program  sponsors  present  each  proposal  before  a  Program 
Evaluaticn  Group  (PEG)  and  then  a  POM  Working  Group  (PT7G)  . 
The  groups'  results  are  then  reviewed  and  evaluated  pricr  to 
submission  to  the  CMC  for  approval.  The  approved  acquisition 
program  funding  profiles  levels  are  included  in  the  Navy 
portion    cf    the    Five    Year   Defense    Plan    (FYDP)       and    become    the 
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Marine  Corps1  input  tc  the  RDTSE,N  POM.  After  Do N /  EOE,  and 
Congressional  negotiations,  Marine  Corps  EDT&E  funds  are 
appropriated  by  Congress  as  part  of  the  RDT&S,N  budget. 

A  sicilar  cyclic  process  is  involved  in  the  development 
and  submission  of  the  PMC  PCM  for  the  allocation  of  funds 
for  the  production  and  deployment  phase  after  a  positive 
milestone  III  decision.  Cne  difference  between  the  two 
processes  is  the  existence  of  an  analytic  support  model  used 
in  the  EMC  process  and  the  current  absence  of  a  support 
model  for  the  EDT&E  process.  The  model  used  during  the  PMC 
POM  process  was  developed  under  civilian  contract  and  is 
described  in  the  final  contract  report,  "Decision-Analytic 
Support  of  the  USMC  Program  Development:  A  Guide  to  the 
Methodology"  [Eef.  5].  Independent  of  the  PMC  model,  the 
CG,MCEEC  developed  a  process  with  the  objective  of  combining 
many  subjective  judgements  from  headquarters  and  operational 
levels  tc  prioritize  EDT&E  acquisition  programs  and  provide 
suggestions  in  program  funding  profiles,  however,  this 
process  has  not  been  implemented. 

I.       TEE  EEOELEM 

Defense  system  research  and  development  programs  indi- 
vidually do  not  possess  an  obvious  numerical  quantity  that 
allows  mathematically  straightforward  program  comparisons  or 
funding  profile  optimization.  Inherent  then  tc  EDT&E 
program  and  funding  decisions  are  the  personal  judgments  of 
the  decision  maker.  These  subjective  decisions  rely  on  the 
information  and  analytic  support  available  to  the  individual 
and  supporting  staff  croup  prior  to  the  decision.  Marine 
Corps  EDT&E  acquisition  programs  are  prioritized  in  upper 
hierarchical  level  committees  and  currently  do  not  utilize 
mathematical  analytical  decision  support.  The  increasing 
fiscal  commitment   associated  with  each  new   defense  program 
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and  the  intense  competition  for  scarce  resources  imply  the 
critical  importance  c±  prioritization  decisions.  Tc  ensure 
presentation  of  the  rest  programs  for  funding  allocations  or 
to  optimize  the  portfolio  of  programs  presented  will  require 
assistance  from  analytical  decision  tools.  The  prioritiza- 
tion process  proposed  by  MCEEC  utilizes  a  model  composed  of 
linear  combinations  of  normalized  subjective  weights.  Other 
methods  of  multi-attribute  analysis  and  models  are  suggested 
in  the  literature  from  industrial  applications  and  theoret- 
ical techniques.  Investigation  into  the  EDTSE  program 
prioritization  process  is  warranted  and  may  provide  opti- 
mizing techniques  which  will  assist  the  Marine  Corps  in 
EDT5E    resource    allocation   and    program    selection. 
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III.  LITER  MORE  REVIEW 

A.   IMTECDUCTION 

The  importance  cf  Research  and  Development  (R&D)  in  the 
private  and  governmental  sectors  is  evident  from  the  quan- 
tity cf  information  available  in  professional  papers,  jour- 
nals, and  Looks.  This  chapter  reviews  a  portion  of  this 
literature  which  concentrates  en  R&D  project  selection  and 
resource  allocation  irodels,  the  suggested  utilization  of 
these  models,  their  limitations,  and  their  acceptability. 
The  purpese  of  this  review  is  to  investigate  demonstrated  or 
proposed  methods  of  solving  a  problem  similar  to  that  previ- 
ously presented  and  should  not  be  viewed  as  an  exhaustive 
study  of  RSD  literature. 

Several  published  articles  review  a  number  of  proposed 
met hcdclcgies  and  models  in  the  R&D  project  selection  and 
resource  allocation  area.  These  review  articles  tend  to 
classify  model  forms  into  one  of  two  general  categories. 
Baker  [Ref.  6]  titled  the  categories  as  "benefit  measure- 
ment" and  "project  selection  and  resource  allocation." 
winkefsky,  et  al.  [Ref.  7]  described  similar  classifica- 
tions as  "value  measurement"  and  "portfolio  selection." 
Benefit  or  value  measurement  models  rely  on  subjective 
expert  judgement  for  project  evaluation  combined  into  check- 
lists, comparative  project  scores,  or  economic  indices. 
Project  or  portfolio  selection  and  resource  allocation 
models  normally  use  a  mathematical  programming  or  ether 
optimizing  technique  to  maximize  a  benefit,  such  as  profit, 
subject  to  constraints,  such  as  budget  and  manpower.  Cther 
articles,  Augood  [Ref.  8],  Gear,  et  al.  [Ref.  9],  Gear 
[Ref.  10],   Newman   [Eef.  1  1  ],   and  other  authors   review  or 
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propose  lodels  that  can  be  classified  into  these  general 
categories.  Benefit  measurement  and  portfolio  selection  will 
be  used  for  model  classification  in  this  review. 

Seme  authors,  Winkofsky,  et  al.  [Ref.  12], 
Baker,  et  al.  [Ref.  13],  and  Allen,  et  al.  [Ref.  14], 
propose  methodologies  for  i npleraentin g  series  of  models  for 
hierarchical  applications.  In  addition  to  the  model  and 
methcdclcgy  proposal  and  review  articles,  Brandenburg 
[Ref.  15],  Baker  [  Bef .  6],  Souder  [Ref.  16  and  17],  and 
other  authors  suggest  USD  model  analysis  criteria  as  well  as 
observed  model  limitations  and  acceptability. 

E.   RESEARCH  AND  DEVEIOPMENT  MODELS 

In  addition  to  the  general  classifications  of  benefit 
measurement  and  portfolio  selection,  models  are  further 
defined  by  a  common  form,  such  as  an  index  model  or  a  linear 
programming  model,  a  description  of  that  form,  and  the 
recommended  or  observed  use  of  the  model. 

1  •   I^£^fii  Measurement  Models 

Eenefit  measurement  models  typically  use  subjective 
evaluation  of  a  number  of  RSD  project  attributes  and  combine 
these  evaluations  into  a  project  value  or  worth.  These 
models  are  classified  into  the  checklist,  scoring  and  index 
model  forms. 

a.   Checklist  Models 

These  models  are  the  simplest  type  and  use 
subjective  comparisons  of  a  project  against  a  list  of 
elements.  The  elements  describe  project  criteria  or 
considerations,  established  by  the  management,  that  have 
some  significance  towards  success.  Augood  [Ref.  8]  suggests 
five  general  criteria  subdivided   into  53  specific  elements. 
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Cooper  [Eef.  18]  surveyed  103  industrial  product  firms  and 
was  able  tc  analytically  reduce  his  48  similar  elements  into 
13  meaningf cl  factors.  Augood  [Bef.  8]  also  suggests  rating 
projects  against  the  checklist  elements  by  using  descriptors 
such  as  very  unf avorable,  unfavorable,  average,  favorable, 
and  very  favorable.  The  worth  of  a  project  is  provided  by 
cbserving  the  number  cf  criteria  it  meets  or  how  "favorable" 
the  project  looks  by  its  overall  element  descriptor  ratings. 
This  method  then  requires  judgemental  evaluations  cf  the 
checklist  results  fcr  each  project.  Winkofsky,  et  al. 
[Ref.  7  ]  in  their  literature  review,  observed  that  checklist 
models  are  most  suitable  for  project  evaluation  in  the 
exploratory  RSD  phase  when  only  preliminary  project  informa- 
tion is  available. 

b.   Scoring  Models 

Scoring  models  are  quantified  extensions  of  the 
checklist  models  and  provide  a  numerical  score  or  value  fcr 
each  project.  Using  a  similar  criteria  list  as  used  in  the 
checklist  models,  the  project  score  is  typically  generated 
from  picducts  of  assigned  criteria  weights  and  project 
values  associated  with  criteria  accomplishment.  These  prod- 
ucts are  then  summed  ever  all  criteria  to  provide  the  final 
project  score.  Winkofsky,  et  al.  [Eef.  7]  presented  the 
general  scoring  model  form  as 

PVj  =  Sum/i  [  (Wi)  (Sij)  ]  (3.1) 

where , 

i    =  criterion  numter, 

j    =  project  number, 

PVj  =  jth  project  value  to  organization, 

Wi   =  ith  criteria  or  element  weight,  and 

Sij  =  jth  project  accomplishment  of  the  ith  criterion. 


24 


The  weights  such  as  Tvi  or  Sij  are  normally  assigned  by  R&D 
managers  or  R&D  advisory  groups  based  on  personal  cr  group 
judgement.  Cooper  [Eef.  18]  empirically  derives  criteria 
weights  through  subjective  survey  data  and  a  mu ltivariable 
regression.  Augood  [Eef.  8]  suggested  applying  the  weights 
C,  2,  5,  S,  and  10  to  his  five  increasing  benefit  element 
descriptors  and  subjectively  assigning  relative  importance 
weights  to  each  element.  He  then  represented  a  project 
score  as 

PVj  =  (100  Sum/i  [  (Ki)  (Sij)  ])/(10  Sum/i  [  Wi  ])       (3.2) 

where  the  previous  notation  of  equation  3.1  is  used.  This 
form  bounds  the  score  between  0  as  failure  to  100  as 
success.  Scoring  models  have  teen  used  for  project  selection 
in  a  number  of  organizations,  according  to  Winkofsky,  et  al. 
[Eef.  7],  with  various  criteria  and  weighting  schemes 
utilized. 

c.   Index  Models 

These  models  directly  involve  probability  of 
project  success  and  costs.  The  general  form  of  an  index 
model  is; 

I  =  (P)  (E)  /  C  (3.3) 

where, 

I  =  project  index  value, 

P  =  project  probability  of  success, 

B  =  project  benefit,  and 

C  =  cost. 

The  differences  in  the  index  models  proposed  in  the  litera- 
ture are  determined   by  what  is  included  in   the  three  model 


parameters.  The  probability  of  success  nay  include 
subfactcr  probabilities  such  as  success  in  research,  tech- 
nology, production,  and  market  areas.  Benefits  include 
items  such  as  savings,  profits,  or  cash  flow.  Costs  range 
from  ESE  investment  tc  total  lifecycle  expenditures.  These 
indices  may  be  used  alone  or  combined  into  other  indices  to 
provide  the  final  prcject  measurement  such  as  the  Anscff 
index,  suggested  by  Einkofsky,  et  al.  [Ref.  7]  as  typical 
cf  RSE  project  selection  indices.  Ansoff's  index  provides  a 
numerical  value  called  the  Figure  of  Merit  (FM)  such  that 

FM  =  rdp  (  T  +  B  )I  /    (Total  investment)  (3.4) 

where, 

r   =    probability    cf   research    success, 

d   =    probability    cf   development    success, 

p   =    probability    of   market    success, 

T   =    index   of    technical    merit, 

B    =    index   of   business   merit,    and 

E    =    present    value   cf  earnirgs   from   project. 

like  the  scoring  models,  the  index  models  combine  a  number 
of  prcject  attributes  into  a  single  value  which  may  then  be 
used  to  rank  projects  and  assist  in  determining  prcject 
selection.  More  cost  analysis  is  reguired  for  typical  index 
models    than   is    generally  necessary    for   scoring   models. 

2 •      Portfolio   Selection    Models 

F-crtfolio  selection  models  are  normally  more  compli- 
cated than  benefit  measurement  models;  however,  they  also 
provide  additional  flexibility  and  realism  to  the  KSD  deci- 
sion maker,  according  to  Souder  £Ref.  17].  Typically  these 
models  utilize  a  mathematical  programming  technigue  to 
assist    in        project      selection    by      providing        the      resource 
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allocation  that  will  maximize  the  benefit  contribution  for  a 
set  cf  possible  projects.  The  models  are  classified  within 
the  portfolio  selection  category  by  tne  mathematical 
programming  form  used.  Linear,  non-linear,  integer,  and 
dynamic  programming  model  forms  have  been  proposed  in 
literature.  Winkofsxy,  et  al.  [ Hef .  7]  observed  in  their 
review  that  these  portfolio  selection  models  assume  that  an 
explicit  benefit  or  contribution  function  can  be  determined. 
They  reviewed  other  authors,  however,  that  utilize  an  inter- 
active programming  mcdel  form  which  assumes  an  implicit 
benefit    function   exists   but    is    never    formally    defined. 

a.      Linear    Programming 

The    general   form   of    the   linear    programming    model 
is 

maximize  ex  (3  -  5 J 

subject    to      Ax      <        b 
0    <   x    <    1, 

where , 

x    =   n-cemponent   project  resource   allocation   vector, 

c    =   n-component   project  benefit   vector, 

A    =    mxn-componen t    project    resource    utilization    matrix,    and 

b    =    m-component   available    resource   allocation  vector. 

Linear  programming  computations  provide  an  optimal  resource 
allocation  for  all  projects  provided  that  the  values  repre- 
sented by  c,  b,  and  A  can  be  explicitly  obtained  and  the 
assumed  linear  relationships  between  resources  and  benefits 
portray  an  accurate  mcdel  of  the  using  organization's  situ- 
ation. The  project  resource  allocation  vector  x,  provided 
by  the  computations,  takes  values  between  and  including  zero 
and      one.      Zero      represents    no      resource      allocated    en      that 
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specific  project  ard  a  one  represents  fall  allocation. 
"Values  between  zero  and  one  provide  the  proportion  of  full 
resource  allocation  necessary  for  the  optimal  solution. 
Asher  [Eef.  19]  proposed  a  linear  programming  model  to  allo- 
cate manpower  teams  irvolved  in  the  testing  operation  of  new 
chemical  compounds  under  development  by  a  pharmaceutical 
company.  The  project  resource  allocation  vector  represented 
the  number  of  tests  of  a  specific  compound  each  team  would 
conduct  and  was  bounded  by  the  total  number  of  each  chemical 
compound  available.2  The  expected  return  of  the  compound  to 
the  firm  was  used  as  the  the  project  benefit  vector  and  was 
calculated  as  the  product  of  the  probability  of  success  and 
the  estimated  net  market  value  of  success  for  each  compound. 
The  project  resource  utilization  matrix  was  equal  to  the 
number  of  hours  necessary  for  each  team  to  test  a  specific 
compcurd  and  was  based  on  the  team's  experience  and  skill 
levels.  The  resource  vector  was  the  manhours  available  for 
each  team.  The  commutation  results  provided  which  manpower 
team  should  test  which  compound  and  the  quantity  of  that 
compound  they  should  test  in  order  to  maximize  the  expected 
value    of    return    to    the    company. 

t.      Non- linear   Programming 

Non-linear  programming  models  are  very  similar 
to  the  linear  models  but  attempt  to  represent  reality  as 
non-linear  relationships  rather  than  strictly  linear. 
Non-linear  models  are  formulated  with  similar  notation  as 
equations  3.5  and  provide  similar  resource  allocation  infor- 
mation. A  non-linear  benefit  function  has  the  intuitive 
appeal  that  as  more  units  of  resource  are  provided  to  a 
project    less  benefit     is   returned   for    each      additional    input 


2The  bound  of  one  was  previously  noted  for  the  typical 
linear  program  model.  Asher's  computations  found  the  actual 
allocation    value   enstead    of    a    proportion. 

28 


unit.  Chidambaram  [Ref.  20]  considered  three  separate 
concave  nondecreasin g  functions;  quadratic,  exponential,  and 
logarithnic;  which  all  approximated  his  U.S.  Army  data  of 
estimated  future  military  benefits  for  a  set  of  projects. 
Souder  [Bef.  16]  proposed  and  analyzed  four  portfolio  selec- 
tion nodels  based  on  similar  models  in  the  literature  using 
thirty  actual  RSD  projects.  For  his  model  Souder  used  two 
types  cf  ncn-linear  benefit  functions  which  are  represented 
by  Figures  3.1  and  3.2.  The  exponential  type,  Figure  3.1,  is 
also  sinilar  to  Chidambaram's  benefit  functions.  Scuder 
suggests  using  this  type  of  function  when  incremental 
resource  expenditures  in  the  lower  x  domain  are  expected  to 
greatly  increase  the  return,  and  the  benefit  diminishes  at 
some  pcint  as  resource  levels  are  increased.  The  S-shaped 
benefit  function,  Pigure  3.2,  was  suggested  for  project 
cases  where  success  was  related  to  a  breakthrough  in  tech- 
nology. In  this  case  the  return  from  the  resource  input  was 
initially  expected  to  be  lower  until  the  breakthrough.  Then, 
small  additional  resource  expenditures  returned  larger 
benefits  until  a  diminishing  return  point  is  reached. 
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Figure  3.1    Exponential  Type  of  Benefit  Function, 
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Figure  3.2        S-Shaped    Type   of   Benefit   Function, 


c.  Goal   Programming 

Goal  programming  is  a  mathematical  programming 
method  which  incorporates  several  objective  functions  as 
organizational  gcals  and  attempts  to  solve  them  simultane- 
ously. The  objective  or  goal  functions  become  the 
constraints  of  a  linear  or  ncn-linear  programming  problem. 
The  problem's  overall  objective  function  is  a  composite  of 
the  goal  functions  which  are  weighted  in  their  relative 
accomplishment  importance  by  the  program  user.  The  computa- 
tion ninimizes  the  prioritized  deviations  from  the  goal 
constraints  as  described  by  the  composite  objective  function 
and  defines  a  ranee  of  feasible  solutions  between  the 
competing  gcals.  Goal  programming  in  RSD  models  is  normally 
used  with  other  model  forms  such  as  in  Taylor,  et  al. 
[Ref.  21]  and   Winkofsky,  et  al.   [Ref.  12]. 

d.  Integer    Programming    Models 

Integer  programming  models  are  formulated  in  a 
similar  manner  to  the  linear  and  non-linear  models,  however 
the    project    resource    allocation    vector      is    constrained    to   be 
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integers  only-  Taylor,  et  al-  [Ref.  21]  utilized  an 
integer  program  model  incorporating  goal  programming  methods 
to  allocate  thirty  researchers  among  seven  P.SD  projects. 
Non-linear  constraints  were  used  to  relate  the  number  of 
researchers  assigned  to  a  project  to  probability  of  success, 
monetary  return,  aid  project  time  completion.  Linear 
constraints  were  used  to  describe  budget  limitations  and 
computer  capacity  utilization.  A  linear  composite  objective 
function  was  used  that  described  prioritized  deviations  from 
each  goal  constraint  and  the  integer  program  computation 
minimized  these  deviations  to  provide  the  optimal  allocation 
solution.  Other  authors  have  proposed  simpler  0-1  integer 
program  models  which  provide  a  go  or  no-go  project  decision 
depending  on  the  resource  allocation  vector  values  cf  cne  or 
zero  respectively. 

e.   Dynamic  Programming  Models 

The  first  three  portfolio  selection  model  forms 
described  are  closely  related  and  differ  only  in  the  benefit 
and  constraint  functional  relationships  and  the  domain  of 
the  resource  allocation  vector.  A  dynamic  programming 
approach  to  R&D  project  selection  provides  a  different  opti- 
mizing technique  with  a  sequential  decision  process.  Hess 
[Ref.  22]  presents  such  an  approach  as  more  typical  of  the 
R5D  budgeting  problem  than  a  current-cycle-only  optimizing 
solution.  Hess  suggests  that  most  R&D  resource  allocation 
models  dc  net  adequately  consider  the  periodic  re-evaluation 
cf  R5E  projects  which  stem  from  the  increase  in  information 
obtained  during  the  RSE  process  as  well  as  the  cyclic  budg- 
eting evolution.  Hess  proposed  using  the  mathematical 
recursive  technique  cf  dynamic  programming  to  develop  an 
optimal  resource  allocation  policy,  Po,  for  the  series  of 
subseguent  project  resource  decisions  stages.  The  general 
recursive  equations  fcr  Hess'  model  are 
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f  1  (x)     =    max   over    P    [    R1(x,P)     ]  (3.6) 

for    the    last   decision,    and 

f n  (x)     =    max   over    P    [    Rn(x,P)     +    fn-1  [xn-1  (x,P)}     ]         (3.7) 

for  the  nth  prior  decision  where, 

fn  (x)  =  maximum  benefit  when  n' decisions  remain, 

x  =  initial  guantity  of  resource, 

P  =  policy  cr  series  of  resource  decisions  used, 

xn-1(x,P)  =  resource  function  of  x  and  ?  at  stage  n-1,  and 

Rn(x,P)  =  benefit  returned  in  stage  n  using  x  and  P. 

Assuming  En(x,p)  is  known  through  some  benefit  measurement 
method,  the  optimal  policy,  Po,  is  calculated  ty  first 
solving  eguation  3.6  for  the  last  decision,  stage  1.  Next, 
eguation  3.7  is  solved  for  n=2  witn  the  substitution  of 
equation  3.6  The  value  of  n  is  increased  and  equation  3.7  is 
solved  again  with  the  substitution  of  the  n-1  results.  Each 
incremental  increase  in  n  represents  the  next  prior  decision 
stage  in  the  sequential  R&D  resource  allocation  process.  The 
dynamic  programming  model  is  dependent  on  knowing  the 
henefit  values  of  Ri(x,P)  (i  =  n,n-1 ,. . . , 2,  1) .  This  requires 
project  information  representing  the  entire  project  R5D 
phase  and  the  number  of  cycles  remaining  until  project  R&D 
completion-  This  information  is  normally  based  on  sutjective 
evaluations  and  estimates  which  are  used  to  derive  the 
resource  to  benefit  relationships.  Gear,  et  al.  [Ref-  9] 
analyzed  several  dynamic  programming  models  similar  tc  and 
including  Hess'  model.  They  observed  that  this  form  of  the 
model  has  the  advantage  of  catering  tc  the  multistage 
learning  and  decision  nature  of  R&D  projects.  Although  this 
aspect  is  referenced  throughout  the  literature,  the  model 
forms  presented  above  do  not  consider  it  as  well  as  the 
dynamic  programming  form. 
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f.      Interactive    Programming    Models 

Winkofsky,   et   al.  £Ref.    7]      reviewed      several 

authors  that  proposed  interactive  programming  models  as 
solution  techniques  for  multiple  criteria  problems.  These 
models  can  provide  helpful  tocls  in  the  R&D  portfolio  selec- 
tion process.  Zoints  and  Wallenius  [fief.  23]  proposed  a 
nan-machine  interactive  programming  method  which  allows  a 
decision  maker  to  optimize  an  implicit  benefit  function 
involving  multiple  objective  or  goal  functions.  The  benefit 
function  is  a  composite  objective  function  and  is  unknown  to 
the  decision  maker;  however,  it  is  assumed  to  be  a  linear 
function,  or  in  a  mere  general  form  a  concave  function,  of 
several  known  goal  functions.  The  implicit  composite  objec- 
tive function  is  iraximized  against  a  set  of  convex 
constraints  through  the  decision  maker's  answers  to  yes-or- 
no  questions  involving  trade  offs  between  possible  goal 
function  solutions.  Zoints  and  Wallenius'  method  initially 
optimizes  a  computer  generated  composite  objective  function 
including  the  goal  function  constraints  and  an  arbitrary  set 
of      functicc        multipliers.  The        technique     produces        a 

Paretc-opti nal  solution  to  the  problem.  Next  a  subset  of 
nonbasic  variables  is  generated  that,  if  introduced  into  the 
basis,  would  continue  to  yield  a  Pareto-optimal  solution. 
For  these  selected  variables  a  series  of  trade  offs  are 
defined  which  increase  or  decrease  each  of  the  goal  func- 
tions and  the  trade  offs  are  presented  to  the  decision 
maker.  The  decision  maker's  responses  to  the  trade  offs  are 
used  to  generate  a  new  set  of  goal  function  multipliers.  The 
new  multipliers  develop  a  new  composite  objective  function 
closer  to  the  implicit  function.  The  authors  state  that 
successive  iterations  of  this  process  assures  convergence  to 
the         cptinal      solution.  Their        premise        is      that        all 

Pareto-optimal    solutions  form    a    subset      of    all   extreme    point 
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solutions  and  with  each  iteration  a  Pareto-optimal  solution 

is  eliminated   from  the  set   of  possible   optimal  solutions. 

Since  there  is  a  finite  number   of  extreme  points  there  will 

be   a  finite   number  of  iterations  required   to  obtain   the 
optima]  solution. 

C.   EECISICN  PROCESSES 

The  najcrity  of  uodels  presented  in  the  literature  are 
proposed  for  or  utilized  in  single  level  organizations. 
Several  authors  have  proposed  extending  these  model  forms 
into  me thcdclogies  or  decision  processes  for  use  by  multi- 
level organizations.  Baker,  et  al.  [Ref.  13]  and 
Winkofsky,  et  al.  [ Bef .  12]  presented  such  processes.  Both 
articles  concentrated  on  budget  allocation  of  R&D  dollars  in 
a  multilevel  organization  and  relied  on  the  interlevel 
communication  and  interaction  to  complete  the  process. 
TCinkofsky,  et  al.  [Ref.  12]  proposed  a  decision  process 
model  in  which  many  subunits  within  a  three  level  organiza- 
tion are  considered.  Each  unit  attempts  to  minimize  the 
deviations  from  its  0-1  goal  constraints.  The  lowest  level 
formulates  and  solves  its  goal  program  and  provides  the 
resulting  solution  to  the  middle  level.  The  middle  level 
formulates  a  goal  program  incorporating  all  subordinate  unit 
program  results  and  additional  constraints  from  the  higher 
level.  In  turn  the  higher  level  solves  a  composite  goal 
program  incorporating  middle  level  results.  Conflicts 
between  the  levels  are  resolved  either  through  communication 
between  levels  or,  if  necessary,  as  directed  by  higher 
levels.  The  process  iterates  to  an  optimal  solution. 

E.   AHAHTIC  HIERARCBI  PROCESS 

Saaty  [Ref.  24  ]  proposes  the  "Analytic  Hierarchy 
Process"  (AHP)  as  a  decision  tool  for  determining  priorities 
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and  making  trade-offs.  Saaty  provides  many  possible  applica- 
tions for  this  process  of  which  BSD  resource  allocaticn  is 
cne .  Ihrcugh  structuring  a  hierarchy  of  criteria  stake- 
holders and  outcomes  and  by  developing  judgemental  cased 
priorities  the  process  contributes  in  complex  problem 
solviEg  and  predicticns  of  likly  outcomes.  AKP  uses  three 
principals  of  analytic  thinking;  structuring  hierarchies, 
setting  priorities,  and  logical  consistency.  AHP  enables 
consideration  of  a  problem  as  a  whole  and  the  study  cf  the 
component  interactions  within  a  hierarchical  prcblem 
description.  Saaty  describes  an  eight  step  process  which 
encompasses  a  graphical  breakdown  of  the  problem  into  a 
decision  tree  hierarchy,  involves  pairwise  criteria  compari- 
sons, establishes  decision  priorities,  and  evaluates  the 
consistercy  of  the  comparisons.  Figure  3.3  shows  his  example 
hierarchy  structure  for  choosing  R&D  projects  to  ensure 
adequate  future  power  and  electricity.  The  figure  lists  six 
levels  of  hierarchy,  one  focus  or  central  objective  and  the 
remaining  levels  each  with  several  elements.  The  process 
involves  a  pairwise  comparison  starting  from  the  top.  A 
higher  level  is  used  as  the  comparison  property  for  the  next 
lower  level.  The  pairwise  comparisons  of  the  elements  under 
a  property  become  the  basis  for  the  computation  of  relative 
element  priorities.  Finally,  the  consistency  of  the  compari- 
sons i=  investigated. 

E.   MCEE1  ACCEPTABILITY  AND  ANALYSIS 

The  acceptability  of  R&D  project  selection  models  by 
industry  and  government  has  long  been  a  problem.  This  is 
evident  from  statements  in  the  majority  of  articles 
reviewed.  Baker  [Ref.  6]  lists  seven  limitations  of  proposed 
R&D  models  based  on  his  and  others'  research.  Baker's 
summary  cf  R&D  model  limitations  is  as  follows: 
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Figure    3.3        R&D    Hierarchy   Example. 
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1)  Inadequate  treatment  cf  project  and  parameter 
interrelations  with  respect  to  both  Benefit  contribution 
and  to  resource  utilization. 

2)  Inadequate  treatment  of  uncertainty  as  it  impacts  in 
benefit  measurement  and  parameter  estimation. 

3)  Inadequate  treatment  of  multiple,  interrelated  deci- 
sion criteria  which  have  no  underlying  measure. 

4)  Inadequate  treatment  of  the  time  variant  property  of 
the  parameters  and  criteria  and  the  associated  problem 
of  continuity  in  the  research  program  and  staff. 

5)  A  restricted  view  of  the  problem  which  (a)  portrays  a 
once-a-year  investment  decision  rather  than  an  intermit- 
tent stream  of  investment  alternatives,  (b)  does  not 
include  such  attributes  as  timing  of  the  decision, 
generation  of   additional  alternatives,    and  recycling, 

(c)  dees  not  recognize  the  diversity  of  projects  alcna 
the  spectrum  from  rasic  research  to  engineering,  and  (dj 
views  the  problem  as  a  decision  event  rather  than  a 
hierarchical,  diffuse  decision  process. 

6)  Nc  explicit  recognition  and  incorporation  of  the 
importance  of  individual  RSD  personnel. 

7)  The  inability  to  establish  and  maintain  balance  in 
the  RSE  program;  e.g.,  balance  between  basic  and  applied 
research,  between  offensive  and  defensive  research, 
between  breakthrough  and  improvement  orientations, 
between  in-house  and  contracted  projects,  between 
product  and  process  oriented  projects  and  between  high 
risk/high  payoff  and  low  risk/moderate  payoff  projects. 


Baker  continues  with  the  conclusion  that  this  list  cf  limi- 
tations makes  it  clear  why  few  RSD  models  have  been  imple- 
mented for  use  by  RSD  managers  and,  in  the  cases  where 
models  are  utilized,  the  majority  are  the  simpler  scoring  or 
index  form. 

Souder  [Ref.  17]  developed  a  scoring  model  to  assess  the 
suitability  of  RSD  models.  His  criteria  used  for  the  model, 
based  on  his  interviews  with  management  scientists  and  RSD 
administrators,  are  presented  in  Table  II.  Souder  then  used 
his  scoring  model  to  rate  26  models  for  use  in  RSD  project 
selection  decision  support.  Index  and  scoring  model  forms 
were  again  found  to  be  in  greater  use  than  other  model 
forms. 


37 


r  

TABLE  II 

Five  Model  Cri 

teria  and  Their  Characteristics 

Criteria 

Characteristics 

REALISM 

model  includes: 

Multiple  Objectives 
Multiple  Constraints 
Market  Risk  Parameter 
Technical  Risk  Parameter 
Manpover  Limits  Parameter 
Facility  Limits  Parameter 
Budget  Limits  Parameter 
Premises  Uncertainty  Parameter 

FLEXIBILITY 

model  applicable  to: 

Applied  Projects 

Basic  Projects 

Priority  Decisions 

Termination  Decisions 

Initiation  Decisions 

Budget  Allocation  Application 

Project  Funding  Application 

CAPABILITY 

models  performs: 

Multiple  Time  Period  Analyses 
Optimization  Analyses 
Simulation  Analyses 
Scheduling  Analyses 

USE 

model  is  characterized  by: 

Familiar  Variables 
Discrete  Variables 
Computer  Not  Needed 
Special  Persons  Not  Needed 
Special  Interpretations  Not  Needed 

CCST 

model  has: 

Low  Set-up  Costs 

Low  Personnel  Costs 

Low  Computer  Time 

Low  Data  Collection  Costs 

F.   SGMMAEI 

This  chapter  has  reviewed  several  R&D  project  selection 
model  forms  found  through  out  the  literature.  The  models 
presented  were  typical   of  the  literature  and   were  the  more 
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general  forms  which  cculd  have  application  in  the  following 
analysis.  The  commonality  observed  between  model  forms  is 
the  use  of  subjective  project  benefit  relationships  in  seme 
manner.  Decision  processes  and  the  Analytic  Hierarchy 
Process  vere  briefly  presented  as  methods  for  approaching 
the  ESD  project  selection  problem.  Table  III  summarizes  the 
models  presented  in  this  chapter.  Other  proposed  project 
selection  models  are  listed  in  the  bibliography.  The  next 
chapter  describes  a  R&D  program  prioritization  process 
proposed  within  the  Marine  Corps,  and  classifies  the  process 
model  form  according  to  the  literature. 
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TABLE    III 

Summary 

of 

Eeviewed   Models  and    References 

Author/Reference 

Mo^ii   Form    Descriptor    Used 

Asher     MS62) 
[Ref.     19] 

linear    Programming 

Augood    (1973) 
[Bef.    8] 

Checklists 

Simple 

Quantified 

Profile 
Indices 

Baker    MS7U) 
[Bef.    6] 

Eenefit    Measurement 
Comparative 

Scoring 

Benefit    Contribution 
Project    Selection/Allocation 

Ranking 

Linear   Programming 

Non-linear    Programming 

Dynamic    Programming 

Integer    Programming 

Chidanraram     (1970) 
[B€f .    20] 

Ncn-linear 

Cooper    (1981) 
[Bef-    18  : 

Empirical     (scoring) 

Hess     (1S62) 
[Bef-    22] 

Dynamic   Programming 

Scuder     M973) 
[Bef.    16] 

Profitability   Index 
linear 
Non-linear 
Zero- One 

Taylor   e t  al. 
[Bef.    21] 

(1982) 

Integer    Ncn-linear 
Goal   Programming 

Winfcofsky  et 
[Bef-    7] 

al. 

(1980) 

Value    Measurement 
Checklist 
Scoring 
Economic    Index 

Portfolio    Selection 
Linear   Programming 
Integer    Programming 
Nonlinear    Programming 
Interactive   Programming 

Win>ofsky  et 
[Bef.    12 j 

al. 

(1981) 

0-1    Goal    Programming 

Zcints   et  al. 
[Bef.    23] 

(1976) 

Interactive    Programming 
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IV.  MCrjC  PRIORITIZATION  PROCESS 

A.   INTECDOCTION 

The  MCDIC  Prioritization  Process  consists  of  four  time- 
dependent  phases  synchronized  with  the  Marine  Corps  partici- 
pation in  the  DOD  Planning  Programming  and  Budgeting  System 
and  is  organized  fcr  implementation  at  the  Marine  Corps 
Development  Center  (EevCtr)  ,  MCDEC.  Figure  4.1  depicts  this 
synchronization  and  the  process  timetable  for  a  single 
cycle.  The  four  phases  include  determining  deficiencies 
and  reguirements,  prioritizing  deficiencies  and  reguire- 
iients,  prioritizing  research  and  development  programs,  and 
completion  of  funding  profiles.  This  process,  as  described 
by  Major  J.  L.  Creed,  USMC,  in  "A  Guide  for  the  Performance 
of  the  Development  of  the  MCDEC  R&D  Program  Prioritization 
Process,  Methodology  Manual"  [Eef.  25],  is  carried  out  under 
the  responsibility  of  the  Office  of  the  Deputy  Chief  of 
Staff  (EC/S),  Developmental  Coordination  (DC),  EevCtr, 
MCDEC,  and  ty  two  primary  grouts,  the  Prioritization  Working 
Group  (PRWG)  and  the  Chief  of  Staff's  (C/S's),  DevCtr 
Prioritization  Committee  (Pri  Com) .  Each  Division  and 
Directorate  of  the  EevCtr  provides  a  representative  for 
membership  in  the  PRWG.  The  Eivision  and  Directorate  Heads 
compose  the  C/S • s  DevCtr  Prioritization  Committee.  Appendix 
A  details  the  phases  and  tasks  of  the  process  and  lists  the 
EevCtr  Divisions,  Directorates,  and  Developmental 
Coordination  Branches  responsirle  for  completing  each  step. 
This  chapter  describes  the  process  concepts  and  concentrates 
on  the  participants  as  shown  in  Figure  4.2  . 
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42 


USMC 

HeaOcuar ters 
Mar \ne    Corps 


__r 


Mgc Ine  Corps 

Deve'opwe^t  and 

Eaucat ion 

Command 


OevploDmpnt 
Cenier 


DC/S 

[>pve  i  otinpMt  a  1 
Cooralnat Ion 


Priori t fiat  ton 

Working   Cw-ouD 


Cnlef    o<    StaM 

DevCtr 

Pr lor '♦ IzBt  Ion 

Cotrmf  t  tew 


J 


Figure  4.2   MCDEC  Process  Participants 


E.   PROCESS  PHASES 


1  .   Fhase  I 


The  determination  of  deficiencies  and  rs quiremen ts, 
phase  I,  involves  three  general  tasks  and  serves  to  prcvide 
the  PEWG  with  an  information  tase  for  the  following  subjec- 
tive evaluations.  First,  the  Marine  Corps  Midrange 
Objectives  Flan  (MMROF)  and  the  Marine  Corps  Long  Range  Plan 
(MLRF)  are  updated  utilizing  Defense  Guidance  (DG) ,  the 
FYDP,  previous  EOM  recommendations,  and  other  appropriate 
research  and  developirent  information. 
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Second,  Fleet  Marine  Force  (FMFJ  input  is  solicited 
by  survey  analysis  through  questionnaires,  opinionnaires, 
and  personal  interviews.  This  task  provides  the  ever.tual 
system  users  with  an  opportunity  to  input  observations  of 
mission  deficiencies,  ideas  for  new  programs,  and  their 
rankings  of  ongoing  programs. 

Finally,  MAAs  are  conducted  which  provide  the  frame- 
work necessary  for  phase  II  and  serve  to  formalize  all  defi- 
ciencies that  diminish  the  capability  to  perform  the  mission 
area.  The  MAAs  are  classified  according  to  the  Mission  Area 
Elements  (MAEs)  listed  in  Table  I,  and  performed  by  project 
officers  under  the  direction  of  the  Planning  and  Evaluation 
Eranch,  DevCtr.  The  assigned  project  officer  conducts  his 
analysis  through  a  series  of  mission  categorizations  which 
are  based  on  the  previously  updated  plans  and  other  estab- 
lished Marine  Corps  Ecctrine.  Three  basic  categorizations 
occur  during  the  MAA.  First,  the  mission  area  element  is 
defined  into  its  general  and  specific  operational  mission, 
then  the  resources  necessary  to  accomplish  the  operational 
missions  are  identified,  and  finally  each  resource  is 
analyzed  against  each  operational  mission  to  identify  if  any 
deficiencies  exist.  The  collection  of  these  identified 
mission  deficiencies  present  the  recommended  corrective 
actions  to  obtain  full  Marine  Corps  capability  in  a  mission 
area . 

2.   Ehase  II 

F-hase  II  merges  the  identified  mission  element  defi- 
ciencies into  a  single  prioritized  list.  To  accomplish  this 
ranking,  the  P3WG  first  receives  briefings  concerning  the 
MAAs  and  survey  analyses  from  phase  I.  Next,  the  PRWG 
constructs  a  decision  tree  based  on  tne  presented  informa- 
tion to  order  deficiencies  within  mission  area  elements. 
The  tree  development   is  represented  by  Figures   4.3  through 
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4.6.  Ihis  development  parallels  the  mission  element  categor- 
ization process  conducted  during  the  NAAs  and  applies  multi- 
attritute  utility  analysis  to  the  categories  as  explained  by 
Creed  [Ref.  25].  The  subsequent  evaluations  of  the  elements 
and  missions,  represented  by  the  decision  tree  branchs,  also 
rely  heavily  on  the  MAAs  as  presented  to  the  PRWG  by  the 
project  officers,  and  by  the  Planning  and  Evaluation  Branch. 
Additional  technical  assistance  for  the  decision  tree 
construction  and  analysis  is  provided  by  the  Analysis 
Support  Eranch. 

The  decision  tree  is  based  in  the  USMC  mission  areas 
and  elements  listed  in  Table  I  and  is  represented  in  Figure 
4.3.  The  tree  branches  through  the  doctrine  based  general 
and  specific  missions  for  each  element  (see  Figure  4.4)  ,  and 
then  these  specific  missions  are  shown  supported  by  the 
necessary  resources,  as  presented  in  Figure  4.5. 
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Figure  4.3    Decision  Tree,  Established  Base. 
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Figure   4.5        Decision   Tree,    Resources. 

Ihe  resources  shown  in  Figure  4.5  are  further 
defined  into  principal  and  ancillary  categories.  Principal 
resoures  correspond  tc  equipment  or  weapon  systems  that  are 
used       to   accomplish      the      specific      mission    directly,  and 

ancillary  resources  are  necessary  but  only  indirectly 
support  the  mission.  A  common  list  of  resources  necessary  to 
accomplish  the  specific  operational  mission  is  initially 
applied  to  all  specific  operational  missions  with  seme 
resources  subsequently  being  determined  not  applicable  for 
all    missions.  As    an    example,         Creed    [Ref.     25]      suggests    a 

possible    resource      list    for      the    close      combat    mission      area 
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Figure  4.6    Decision  Tree,  Deficiencies. 

element  to  be  direct  fire,  assault,  and  anti-armor  weapons 
for  the  principal  resource  category  and  communication  equip- 
ment and  target  acquisition  devices  for  the  ancillary 
resources.  The  resource  deficiencies  and,  thus,  the  mission 
deficiencies  shown  in  Figure  4.6  are  identified  by  evalu- 
ating €ach  resource  as  it  supports  the  accomplishment  of  the 
specific  operational  irission. 

The  PRWG  assigns  subjective  importance  values3  (0.01 
to  1.00),  to  each  branch  of  the  decision  tree  from  the 
mission  area  through  the  deficiency  level.  These  values  are 
based  on  presented  information  and  finalized  through  collec- 
tive group  judgement.  The  Mission  Area  Values  (MAV)  repre- 
sent the  relative  impcrtance  of  each  mission  area  within  the 
USMC  mission  and  the  Mission  Area  Element  Values  (MAEV) 
represent  the  relative  importance  of  each  mission  area 
element  within  the  mission  area.  Similarly,  General 
Operational  Mission  Values  (GOMV) ,  Specific  Operational 
Mission  Values  (SOMV),  and  Deficiency  Values  (DV)  represent 
the  relative  importance  of   each  general  operational  mission 


3These  yalues  represent  linear  relative  importance,  (ie, 
a  .74  deficiency  is  twice  as  critical  as  a  .37  deficiency). 
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within  the  mission  area  element,  eacn  specific  operational 
mission  within  the  general  operational  mission,  and  each 
deficiency  within  the  specific  operational  mission  respec- 
tively. The  initial  value  sets,  MAEV,  GOHV,  SOMV,  and  £V, 
are  normalized  to  a  common  rase  for  each  set  which  allow 
comparisons  across  all  elements,  missions,  and  deficiencies 
in  their  respective  decision  tree  level.  The  Deficiency 
Relative  Importance  Weight  (DEIS)  for  each  specific  mission 
deficiency  is  defined  as 

DRIE  =  MAV  •  MAEV  •  GOHV  •  SOMV  •  DV  (4-1J 

where , 

MAV   =  Mission  Area  Value, 

MAEV  =  Mission  Area  Element  Value, 

GCMV  =  General  Operational  Mis'sion  Values, 

SCMV  =  Specific  Operational  Mission  Values,  aQ d 

DV    =  Deficiency  Value. 

The  ERIWs,  in  turn,  determine  a  mission  deficiency  rank 
ordering. 

3.   Phase  III 

Phase  III  prioritizes  ongoing  RDTSE  acquisition 
programs  through  presentation  of  the  prioritization  group 
and  committee  with  available  information,  assigning  program 
subjective  values,  deriving  program  effectiveness,  combining 
previous  program  pricritiza tions,  and  presenting  the  results 
for  Director,  DevCtr  approval.  First,  the  Prioritization 
Working  Group  receives  briefs  by  the  Developmental  Project 
Officers  (DPOs)  to  assist  in  determining  the  worth  and 
utility  of  the  program.  Next,  survey  analysis  briefings 
provide  the  FMF  evaluations  of  current  RDTSE  programs.  This 
information  presented  in  the  PRWG  briefs  is  alsc  provided 
separately  to  the  DC/S  DC  Prioritization  Committee. 
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The  next  task  of  phase  III  is  the  subjective  priori- 
tization of  EDT&E  programs.  During  this  task,  a  sample  of 
experts  are  solicited  for  their  desired  RDT&S  program  rank 
crderings  and  relative  worth  values  (0.01  to  1.00).  This 
opinion  sample  consists  cf  the  DC/S  DC  Prioritization 
Committee  membership,  oinimally,  and  may  include  other  qual- 
ified individuals.  Ihe  prioritization  is  performed  using  an 
analytic  Delphi  process  where  the  independent  rank  ordering 
and  worth  values  are  combined  and  returned  to  the  sample 
membership  for  study  and  resubmission.  After  at  least  three 
replications  with  relatively  common  consecutive  listings, 
the  prioritization  concludes  with  a  program  ranking  and 
program  Subjective  Evaluation  Values  (SEVs) . 

Following  the  subjective  evaluation  the  RDI&E 
programs  are  prioritized  based  on  their  mission  deficiency 
effectiveness.  The  EEWG  identifies  all  deficiencies  within 
each  mission  element  that  are  directly  affected  by  a  EDT&E 
program,  and  it  evaluates  the  proportion  at  which  the 
program  accomplishes  the  specific  deficiency.  This  propor- 
tion is  defined  as  the  Program's  Proportion  of  Deficiency 
Accomp lishment  (PPDA).  The  evaluation  process  relies 
heavily  en  the  input  from  the  EPOs  concerning  each  program's 
proposed  operational  characteristics.  The  product  of  the 
specific  DEIW,  assigned  in  phase  II,  and  the  specific  PPDA 
are  summed,  over  all  deficiencies,  to  obtain  a  program 
Deficiency-Derived  Efficiency  Value  (DDEV)  as 

DDEV  =  Sum/d  [  (DEIW)  •  (PP  EA)   ]  (4.2) 

where , 

Sum/d  =  Summation  ever  all  deficiencies, 

DEIW   =  Deficiency  Relative  Importance  Weight  and 

PPEfl   =  Frogram's  Proportion  of  Deficiency  Accomplishment. 

Ihe  programs  are  then  ranked  according  to  the  DDEV  values. 
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The  PRWG  ohtains  a  final  RDISE  program  ranking  by 
combining  the  subjective  and  deficiency-derived  prioritiza- 
tions. A  Subjective  Evaluation  List  Weight  (SELW)  and  a 
Deficiency-Derived  List  Feight  (DDLW)  is  assigned  to  the 
appropriate  program  list  combining  them  in  a  linear  rela- 
tionship based  on  PRKG  consensus  of  each  list's  validity. 
The  sum,  by  program,  of  the  weighted  prioritized  lists 
provides   the  Final    RETSE   Program   Value    (FPV)     as 

FPV    =     (SELW)  •  (SEV)     +     (DDLW)  •  (DDEV)  (4.3) 

where , 

SEIW    =    Subjective    Evaluation    List    Weight, 
SE"V      =    Subjective    Evaluation    Value, 
DE1W    =   Deficiency-Ierived   List    Weight,    and 
DDEV    =   Deficiency-Derived    Efficiency    Value. 

The    final      prioritized    ranking   is    accomplished     according    to 
the    FPV    and    this   completes    phase    III. 

4.      Phase  IV 

Phase  IV  completes  the  annual  process  by  sumirarizing 
the  three  preceding  chases  and  proposing  funding  profiles 
which  reflect  the  prioritized  program  ordering.  The  process 
summary  is  used  as  a  turnover  file  for  the  next  prioritiza- 
tion cycle  and  the  funding  profiles  are  submitted  to  HQMC 
for  utilization  in  the  RDTSE  PCM  development  process.  Creed 
[Ref.  25]  suggested  further  development  in  this  phase  which 
has  not  yet  taken  place.  Currently,  these  funding  profiles 
are  developed  based  en  solely  the  judgement  of  the  tasked 
EevCtr  hranch  using  no  mathematical  optimization  or 
algorithms. 
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C.  ECRM  CI  MODE!  IH  KCDEC  PROCESS 

Throughout  the  literature,  as  reviewed  in  the  previous 
chapter,  and  in  the  following  analysis  the  form  of  a  budget 
allocation  and  program  selection  model  is  important.  Ihe 
MCDEC  ircdel  as  described  is  a  benefit  measurement,  scoring 
model.  As  with  typical  models  of  this  type,  the  MCDEC  model 
combines  various  attributes  iDto  a  single  valae.  Within 
this  model  form  classification  differences  in  subjective 
benefit  weight  assignment  schemes  are  observed.  Ihese 
differences  range  between  weight  assignment  by  a  single 
manager  to  assignment  based  on  a  multivariable  regression  cf 
subjective  program  evaluations  from  many  solicited  sources. 
The  MCEIC  process  attempts  to  base  its  benefit  weight 
assignment  on  many  inputs  from  operational  and  ncn- 
cperaticnal  forces  as  well  as  agencies  outside  of  the  Marine 
Corps.  Ihe  inputs  are  combined  into  benefit  weights  through 
a  group  consensus  procedure.  In  general  the  MCDEC  prioriti- 
zation process  is  similar  to  RSD  project  selection  models 
proposed  in  the  literature  and  is  classified  with  the 
majority  of  implemented  models  in  industry. 

D.  SCMMARS 

This  chapter  has  presented  the  MCDEC  prioritization 
process  as  described  by  Creed  [Ref.  25]  and  by  information 
obtained  through  liaison  with  the  process  developing  agency, 
the  Analysis  Support  Eranch,  DC/S  DC,  DevCtr.  The  process 
emphasizes  synchronization  with  the  Marine  Corps  participa- 
tion in  the  DoD  PPBS,  and  utilization  of  RSD  program  evalua- 
tion input  from  many  organizational  levels.  The  process 
requires  several  subjective  evaluations  concerning  the  RSD 
programs  and  mission  deficiencies  which  are  then  ccmtined 
into  a  basis  for  RSE  program  ranking.  Table  IV  summarizes 
the  subjective   parameters  necessary  for  the   process.    The 
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chapter  concludes  with  classifying  the  model  form  used  in 
the  MCEEC  process  as  a  benefit  measurement  scoring  model, 
according  tc  similarities  with  proposed  models  in  the  liter- 
ature.The  literature  suggests  other  model  form  applications, 
model  littitations,  and  model  evaluation  criteria  which  will 
assist  further  investigation  cf  possible  improved  alterna- 
tives   cr   enhancements    to   the    MCDEC   prioritization    process. 


r 

TABLE    IV 

Subjective    Model    Parameters 

£Ji2E 

1£SK 

PARAMETER 

ASSIGNMENT 

RANGE 

II 
II 
II 
II 
II 

3 
3 
3 
3 
3 

MAT? 

MAEV 

GOMV 

SOMV 

DV 

PRWG 
PRWG 
PRWG 

PRWG 
PRWG 

0.01-1  .00 
0.01-1.00 
0.01-1.00 
0.01-1.00 
0.01-1.00 

III 
III 
III 
III 

3 

4 
5 
5 

SEV 
PPIA 
SEIK 
DDIK 

Pri    Com 

PRWG 
PRWG 
PRWG 

0.01-1.00 
0.01-1.00 

NS 

NS 

NS    =    Not 
Tasks    are 

Specified 
detailed   in    Appendix    A 
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V.  A  MCDIC  PORTFOLIO  SELECTION  MODEL 

A.   IHTBCDUCTION 

The  MCDZC  process  presented  in  the  previous  chapter  was 
identified  as  a  benefit  measurement  scoring  model  with 
similar  characteristics  as  models  currently  used  in 
industry.  The  literature  also  proposes  portfolio  selection 
models  which  use  benefit  measurement  relationships  to  opti- 
mize resource  allocation  through  various  mathematical 
programming  technigues.  The  HCDEC  process,  as  proposed, 
does  not  attempt  to  optimize  program  resource  allocation 
and,  thus,  the  obvious  first  process  improvement  tc  be 
investigated  is  the  extension  of  the  current  model  into  a 
portfolio  selection  model.  The  simplest  and  most  comprehen- 
dable  way  This  can  he  accomplished  is  by  formulating  the 
process  as  a  linear  programming  model.  This  model  form 
approximates  resource  and  benefit  relationships  with 
straightforward  linear  functions  that  are  easly  understood. 
The  linear  programming  model  is  the  basic  structure  for 
ether  irore  complicated  portfolio  selection  models  and  will 
provide  a  base  for  observing  advantages  from  a  process  model 
change.  The  primary  purpose  of  the  following  linear  program 
development  is  tc  illustrate  the  feasibility,  flexibility, 
and  required  assumptions  of  a  portfolio  selection  model  as 
applied  to  the  MCDEC  prioritization  process  and  does  not 
include  all  constraints  and  relationships  required  fcr  a 
complete  RBT5E  funding  allocation. 

E.   ECBflOlATION 

The  initial  step  of  any  linear  programming  formulation 
can  be  viewed   as  a  thought  exercise.   In   this  exercise  the 
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linear  program  is  viewed  as  a  black  aox  which  provides  an 
output  when  given  the  necessary  data.  The  thought  exercise 
defines  the  desired  output  and  the  remaining  forirulation 
structures  the  linear  program  to  obtain  this  output.  The 
currently  proposed  MCDEC  process  output  provides  a  priori- 
tized program  listirg  based  or  relative  program  importance 
in  accomplishing  mission  deficiencies.  A  linear  programming 
output  which  represents  the  proportion  of  a  program  that  is 
selected  or  furded  provides  program  prioritization  and, 
additionally,  resource  allocation  information. 

The  next  formulation  step  is  to  define  index  nomencla- 
ture for  the  element  categories  under  consideration  in  the 
linear  program.  The  MCDEC  process  concentrated  on  two 
elements,  mission  deficiencies  and  EDT&E  programs.  These  two 
are  also  used  in  the  following  linear  programming  model 
formulations.  The  indexing  letter  i  will  represent  a 
program  and  the  letter  j  will  represent  a  mission  defi- 
ciency. Also,  when  considering  a  resource  allocation 
process  several  time  periods  are  normally  necessary.  The 
letter  k  will  be  used  to  index  a  time  period  in  the  formula- 
tion.. The  total  number  of  programs,  deficiencies,  and  time 
periods  will  be  represented  by  the  letters  p,  d,  and  t 
respectively.  In  the  following  discussion  the  series  summa- 
tion of  any  indexed  values  will  be  denote!  as  Sum/index 
[indexed  values]  such  as  Sum/i[Xi],  which  represents  the 
summation  of  the  values  Xi  over  i  =  1...p,  where  p  is  the 
total  number  of  programs  under  consideration. 

The  benefit  measurement  output  data  provided  ty  the 
MCDEC  process  is  defined  in  the  previous  chapter  and  is  used 
here  for  the  linear  program  formulation.  Four  value  sets  of 
interest  are  developed  in  the  MCDEC  process.  The  Deficiency 
Relative  Importance  Weight  (DBIWJ  is  established  in  phase 
II.  In  phase  III  the  Prioritization  Working  Group  develops 
the   Program's    Proportion   of   Deficiency   Aco omplishment 
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(PPDA),  and  the  Subjective  Evaluation  Value  (SEV) .  Ihese 
three  values  are  combined  in  equations  4.2  and  4.3  to 
provide  the  Final  RDTSE  Program  Value  (FPV) .  Resource  data 
is  net  defined  in  the  current  process  but  is  considered 
during  Project  Development  Officer  briefs  to  the  prioritiza- 
tion group  and  committee.  The  resource  data  is  also  used  in 
phase  IV  to  provide  suggested  RDTSE, Navy  POM  input.  Previous 
POMs  that  are  independent  of  the  process  are  used  as  proxy 
resource  estimators  for  illustration  in  the  following 
formulations. 

The  decision  variables  for  the  formulations  are  implied 
from  the  desired  output.  The  following  series  of  linear 
programs  will  be  formulated  using  the  decision  variable  Xi 
which  represents  the  proportion  of  the  ith  program  that  is 
funded  or  Xik  which  represents  the  proportion  of  the  ith 
program  that  is  funded  in  the  kth  time  period.  The  values 
Xi  and  Xik  are  defined  between  and  including  zero  and  one. 
A  variable,  Yi,  which  represents  the  proportional  deviation 
from  a  fixed  jth  deficiency  accomplishment  goal  is  used  in 
later  linear  programming  formulations  and  is  also  defined 
between  and  including  zero  and  one. 

As  in  the  literature,  the  objective  functions  for  the 
following  formulations  are  provided  from  the  benefit  meas- 
urement irodel.  For  the  initial  linear  program  formulation 
the  Final  Program  Value  (FPV)  vector  from  the  MCDEC  process 
is  used.  This  vector  represents  a  combination  of  deficiency 
derived  and  subjectively  assigned  mission  deficiency  accom- 
plishment program  values.  The  vector  FPV  contains  a  value 
PPVi  for  each  program,  where  i  is  an  integer  froi  1  to  p. 
Formulation  5.1  provides  an  initial  unconstrained  linear 
programning  model  that  is  equivalent  to  the  MCDEC  benefit 
measurement  model  and  can  he  solved  by  observation.  This 
linear  program  naximizes  the  total  relative  program  impor- 
tance as  individually  defined  hy   each  FPVi,   reduced  by  the 
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available  progran  funding  proportion  Xi,  and  summed  ever  all 
programs.  The   optical      solution    for      this    for  mulaticr.      is 

obtained  when  Xi  is  set  at  one  for  all  i.  The  initial  formu- 
lation   is 

maximize  Sum/i      [  (FPVi)  (Xi;  ]  (5.1) 

subject    to:         0    <    Xi    <    1 
i    =    1 ...  p. 

Formulation  5.1  may  be  trivial  but  it  provides  a  linear 
program  structure  equivalent  tc  the  MCDEC  process  which  can 
be  constrained  by  budget  or  deficiency  relationships. 
Formulation  5.2  provides  a  constrained  version  of  formula- 
tion 5.  1  as 

maximize      Sum/i  [  (FPVi)  (Xi)  ]  (5.2) 

surject  to 

Sum/i  [  (Aki)  (Xi)  ]  <  Ek 
0  <  Xi  <  1 
i  =  1...p 
k  =  1...t 

where , 

FPVi  =  ith  final  program  value, 

Xi    =  proportion  of  ith  program  funded, 

Bk    =  available  budget  resource  in  time  period  k, 

Aki   =  full  funding  level  of  ith  program  in  time  period  k, 

p     =  number  of  picgrams,  and 

t     =  number  of  tine  periods. 

If  Bk  is  greater  than  or  egual  to  Aki,  summed  ever  all 
programs   for  each   time  period,    the   optimal  solution   to 
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formulation  5.2  is  also  at  Xi  e^ual  one  for  all  i.  This 
formulation,  however,  will  provide  a  tool  to  observe  the 
cptiiral  allocation  change  when  the  budget  level  Bk  is 
reduced,  thus  constraining  the  objective  function.  The  new 
optinal  program  priority  listing  will  not  necessarily  be  the 
same  as  the  ordering  provided  by  FPV.  After  the  linear 
progran  computations,  the  vector  (FPV)  (X)  represents  the 
proportional  reduction  in  the  programs'  Final  Program  Value 
and  provides  the  revised  priority  listing  under  budget 
constraints . 

Fcrmulation  5.2  is  illustrated  by  an  example.  lable  V 
lists  the  benefit  measurement  output  values  from  four  PDTSE 
programs  considered  during  a  partial  MCDEC  process  test 
conducted  ty  the  Development  Center.  The  respective  budget 
allocation      data   froir      the      RDT&E    POM      is      also    listed.  A 

constant  is  imbedded  into  the  linear  program  formulation 
which  defines  possible  budget  reductions  and  thus  a  fighting 
cf  the  constraints.  The  constant  is  added  by  replacing  the 
budget    constraints    of    formulation    5.2    with 

Sum/i    [  (Aki)  (Xi)   ]    +    BR(Bk)     <    Bk  (5.3) 

where  , 

BR    =    budget   reduction    proportion. 

Eight  progressivly  reduced  budget  conditions  are  used  in 
this    example. 

Table  VI  lists  the  resulting  optimal  solutions  and  rank- 
ings for  each  of  the  eight  budget  conditions.  The  proportion 
cf  full  funding  for  each  project  changes  but  not  as  the 
MCDEC  prioritizing  vector  FPV  implies.  Although  the  FFV  of 
program  C0020  is  larger  than  the  FPV  for  both  programs  C0021 
and  CC082,  the  latter  two  programs  are  fully  funded  at  each 
budget    reduction.      The    values    of    FPV    alone    would    not    suggest 
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TABLE    V 
MCDEC   Portfolio   Selection   Model    Example   !2>ata 


Program        FPV 


C1  120 

C0020 
C002  1 
C0C82 


7.32464 
6.9616 
4.79723 
4.21985 


yr    1 

4747 

21100 

4172 

361 


Budget   Data 

yr    2  yr    3  yr   4 


20874 

22200 

4297 

370 


9176 

30100 
4369 

380 


8937 

33700 

4268 

442 


yr  5 

8988 

7C500 

3927 

443 


Budget    Sum   =Bk=       30380         47741         44025         47397       83859 


these  funding  reductions.  For  this  example,  observation  of 
the  differences  in  the  programs'  budget  profiles  as  listed 
in  Table  V  would  imply  that  the  optimal  funding  in  a  budget 
constrained  problem  would  be  obtained  by  reducing  the  most 
expensive  program  first.  However,  in  a  larger  example  the 
optima]    solution   may    not   be    as    evident. 

Formulation  5.2  can  be  expanded  to  include  a.  time  index 
for  the  funding  proportion  variable  X.  This  expansion  is 
formulated    as 


maximize      Sum/k   [ Sum/i    (FPVi)  (Xik)  ] 


(5.4) 


subject    to 

Sum/i    [  (Aki)  (Xik)   ]    +    BR  (3k)     <    Bk 
0   <    Xik    <    1 
i    =    1 . . .p 
k   =    1.  ..  t 
where , 

BR      =    rudget    reduction   proportion,    and 

Xik   =    proportion    of   ith    program   funded    in    the  kth    period, 
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The  data  values  for  F£Vi,  Aik,  and  Bk  remain  tha  same  as  in 
formulation  5.2.  Formulation  5.4  provides  greater  flexi- 
bility in  funding  level  possibilities  and  provides  a 
sequence  of  program  rankings  for  each  subsequent  year.  Table 
VII  provides  a  summary  of  the  funding  proportion  solutions 
and  the  ranking  according  to  the  vector  (FPV)  (X)  for  each 
year  and  budget  condition.  The  most  expensive  program  C0020 
is  again  the  only  program  that  requires  less  than  full 
funding  except  in  the  most  extreme  condition  where  program 
C1172  is  also  less.  Observing  the  proportional  funding 
profile  of  program  C0020  implies  that  the  first  time  period 
is  the  most  restrictive  in  each  budget  condition. 
Considering  funding  levels  in  each  time  period  allows  a 
greater  utilization  of  resources  available  in  the  less 
restrictive  periods. 


TABLE    VI 

. 

i 

Formulation 

5.  2 

Solut 

ion   Results 

Proportion   of 

Full    3U 

dget 

1  .0 

.99 

.95 

.90 

.85 

.80 

.75 

.50 

Vector   X 

C1120    X1 

1.0 

1.  0 

1.0 

1.0 

1.0 

1.0 

1.0 

.92 

C0020    X2 

1  .0 

.975 

.892 

.784 

.677 

.57 

.462 

0.  0 

C0021    X3 

1.0 

1.0 

1.0 

1.0 

1.0 

1.0 

1.0 

1.0 

C0C82    X4 

1  .0 

1.0 

1.0 

1.0 

1  .0 

1.0 

1.0 

1.  0 

BE 

.00 

-01 

.05 

.  10 

.  15 

.20 

.25 

.50 

Ranking 

C1120 

1 

1 

1 

1 

1 

1 

1 

1 

C0C20 

2 

2 

2 

2 

3 

4 

4 

4 

C0021 

3 

3 

3 

3 

2 

2 

2 

2 

C0082 

4 

4 

4 

4 

4 

3 

3 

3 

Notes 

1.       X 

=   Prop 

or ticn 

of    p 

cog  ram 

funded 

and  is 

speci 

fie 

for 

each 

budget 

re  duction 

case. 

2.       BR 

=  Prop 

or tion 

of    b 

udget 

reduction. 

3.      Ranking   is    acco 

rding 

to    th 

e    vector 

(FPV) 

(X)  . 
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TABLE    VII 
Formulation   5.  4      Solution   Results 


1.0 


99 


Proportion    cf 
.95  .90 


Full    Budget 

.35         .80      .75 


C1120 
yr1-5 

C0020 

y«  i 

3 

4 

c 

C0021 

yr1-5 

C0C82 
yr  1-5 

BE 


Xik    Matrix 


1.0       1  .0 


1  .0 
1  .0 
1.0 
1  .0 
1.0 


97  9 
985 
986 

98  8 
986 


1.0       1.0 


1.0 

.00 


Racking 

C1120  1 

C0020  2 

C0021  3 

C0C82  4 


1  .0 
.01 


1 

2 
3 

4 


1.0 


.892 

.927 

.93 

.94 

.928 


1.0 


1.0 

.05 


1.  0 


784 
854 
859 
881 
856 


1.  0 


1.0 
.  10 


1 
2 

3 

4 


1.0 


677 
780 
789 
821 
784 


1.  0 


1.  0 
.  15 


1.0   1.0 


.57 
.  707 
.719 
.762 
.712 


46  2 
634 
648 
702 
640 


1.0   1.0 


1.0 
.20 


1.0 
.25 


1  1 

2  3 

3  2 

4  4 


Notes 
1. 


.50 


92i 


0.0 

.269 

.298 

.405 

.280 


1.0 


1.0 

.50 


C1120    is   funded  at    .92    for   year    one    only    and    at 
1.0  for   the    years    two    through    five. 
Xik  =    Proportion   of    program   funded   and   is    specific 
for  each   year    and    tudget   reduction   case. 
EE      =    Proportion   of    tudget   reduction. 
Ranking   is    according    to    the    vector 
(FPV)  (Sum/yr    (X)). 


The  Final  Program  Value  (FPV)  provided  by  the  MCDEC 
process  as  a  benefit  measurement  is  postulated  to  represent 
the  relative  program  importance  in  accomplishing  mission 
deficiencies.  The  primary  purpose  of  defense  systems  acqui- 
sition and  Marine  Corps  RDT8E  as  presented  previously  in 
Chapter  II,  is  the  accomplishment  or  alleviation  of 
mission  deficiencies.  Concentration  on  a  portfolio  selec- 
tion model  which  considers  only  the  FPV  and  budget 
constraints      may      net      produce      solutions      representing      the 
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greatest  accomplishment  of  individual  mission  deficiencies. 
The  next  two  proposed  formulations  consider  mission  defi- 
ciency accomplishment  in  terms  of  other  HCDEC  output  values 
under  separate  constraining  conditions.  A  third  additional 
formulation  concentrates  directly  on  the  number  of  deficien- 
cies alleviated. 

Formulation  5.5  optimizes  at  a  level  in  the  *CEEC 
benefit  measurement  model  where  each  deficiency  is  consid- 
ered individually.  The  FPV  is  constructed  from  the  previ- 
ously presented  values  of  SEV  and  DDEV.  The  DDEV  directly 
considers  each  deficiency  where  the  SEV  is  the  subjective 
evaluation  of  the  RDTSE  programs  only.  Equation  4.2  defines 
the  vector  DDEV  as  the  product  of  the  Deficiency  Relative 
Importance  Weight  (EFIW)  and  the  Program  Proportion  of 
Deficiency  Accomplishment  (FPBA)  summed  over  all  deficien- 
cies. Letting  the  vector  PPDA  be  linearly  reduced  by  the 
funding  proportion  of  the  respective  program  provides  a 
means  to  optimize  the  missicn  deficiency  accomplishment 
directly.  The  linear  program  to  maximize  the  F.DTSE  program's 
EDEV  is  formulated  as 

maximize   Sum/i  [  (lEEVi)  { Xi)  ]  (5.5) 

or  eguivalertly, 

maximize   Sum/i  [Sum/j  [  (DRIWj)  (PPDAji)  (Xi)  J] 

subject  to 

Sum/i  [  (Aki)  (Xi)  ]  +  ER (Bk)  <  Bk 

0  <  Xi  <  1 

i  =  1  . . .p 

j  =  1...d 

k  =  1...t 

where  , 

d    =  number  of  deficiencies/ 
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DDEVi        =    ith    program's  deficiency    derived    effectiveness, 
DRIEj        =    jth    deficiency    relative   importance   weight,    and 
PPDAji      =   ith    program's  accomplishment    of    jth    deficiency. 

Additional  constraints  concerning  individual  mission  defi- 
ciencies which  establish  lower  bounds  on  the  deficiency's 
accomplishment  level  may  he  included  in  formulaticn  5.5. 
These  lcwer  bounds,  hcwever  ,  introduce  the  possibility  of  no 
feasible  linear  programming  solutions  existing  because  the 
lower  bounds  are  set  too  high.  Adding  a  new  variable,  Yj, 
which  represents  the  deviation  from  accomplishing  the  lower 
bound  alleviates  this  possibility.  With  the  variable  Yj 
included  the  lower  bcund  becomes  a  deficiency  accomplishment 
goal.  Including  the  additional  deficiency  accomplishment 
constraints   the    formulation    becomes 

maximize      Sum/i   [Sun/j    [  (DEIEj)  (PPDAji)  (Xi)  ]]  (5.6) 

suhject   tc 

Sum/i    [  (Aki)  (Xi)  ]    +    ER  (Bk)     <    Bk 

Sum/i    [  (PPDAji)  (Xi)  ]    +     (Yj)    (DAj)     >    DAj 

0    <    Xi    <    1 

0    <    Yi    <    1 

i   =    1 . ..  p 

j    =    1...d 

k    =    1...t 

where  , 

DAj  =    jth    deficiency's   accomplishment   level,    and 

Yj  =   deviation   from    DAj    achieved. 

The      sclution    to      formulation  5.6      will   provide      program 

selection,      prioritization,         and  deficiency      accomplishment 

information.        Progran      selection  criteria      can      be      defined 

according    tc  the    funding   level.  If    the   ith    P.DTSE    program's 
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funding  level,  Xi ,  is  zero  it  follows  that  the  ith  RDISE 
program  should  net  be  selected  under  the  constraints  estab- 
lished in  the  linear  program.  RDTSE  programs  that  have  low 
proportional  funding  levels,  Xi,  serve  to  identify  EDTSE 
programs  that  may  need  to  te  reevaluated  according  tc  their 
economical  accomplishment  of  mission  deficiencies  prior  to 
continued  investment. 

Tc   prioritize  the   RDTSE   programs,   two   possibilities 
follow  from  the   present  MCDEC  process  and   formulation  5.6. 
The  possible  prioritization  vectors  are 

[  (LEEV)  (X)  ]  (5.7) 


or, 


(X)  [  (DELW)  (DDEV)  +(SE1W)  (SEV)  ]  =  (X)  (FPV)  (5.8) 

where , 

SEEK  =    subjective    evaluation    list    weight, 

SEV  =    subjective    evaluation    value, 

DD1E  =   deficiency-derived    list    weight, 

DDEV  =    deficiency-derived    efficiency    value, 

FPV  =    final    progran   value,    and 

X  =   program   proportion    funded. 

Equations  5.7  and  5.6  represent  vectors  that  could  te  used 
deper.dirg  on  the  importance  given  to  the  vector  SEV.  The 
listings  weights  represented  by  SELW  and  DDLW  are  assigned 
ty  the  Prioritization  forking  Group  (PRWG)  to  compute  the 
FPV  in  phase  III  of  the  MCIEC  process.  If  full  funding  is 
available,  ranking  programs  by  equation  5. 8  is  equivalent  to 
the    current    MCDEC   prioritization    process. 

Formulation        5.6   also      provides   a      proportion    of      defi- 
ciency  accomplished    according    to    the    value 
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Sum/i  [ (PPDAji) (Xi)  ].  (5.9) 

This  information  would  be  valuable  to  a  decision  maker  for 
identifying  deficiencies  that  are  not  fully  accomplished. 
The  additional  variatle,  Yj,  provides  similar  identification 
information  concerning  deficiencies  not  achieving  their 
minimum  accomplishment  levels  as  set  by  the  constant  DAj. 

Tc  further  illustrate  the  linear  programming  model 
formulations  presented  in  this  section  a  larger  set  of 
Eevelcpment  Center-produced  MCDEC  process  test  data  is  used. 
The  cata  involve  158  mission  deficiencies  and  74  RDTSE 
programs.  The  proxy  budget  data  is  obtained  by  using  the 
same  jear  RETSE,Navy  I0M. 

Table  VIII  shows  the  results  of  this  larger  data  set 
when  subjected  to  formulation  5.2.  The  table  lists  six 
columns.  The  first  two  columns  from  the  left  name  and 
describe  the  budget  conditions  used.  The  next  three  list 
the  number  of  RDTSE  programs  fully,  partially,  or  not  funded 
respectively.  The  last  column  provides  the  number  of  changes 
to  the  original  program  prioritization  list  when  using 
formulation  5.2.  The  results  depict  the  BDTSE  program  selec- 
tion produced  by  the  linear  programming  model  solution  for 
naximizirg  the  Final  Program  Value  (FPV)  subject  to  five 
progressively  restrictive  budget  cases.  As  should  be 
expected,  fewer  programs  are  funded  fully  as  budget  reduc- 
tions are  imposed.  However,  if  the  FPV  prioritization 
listing  is  used  to  select  the  funded  programs,  the  optimal 
selection  obtained  through  the  linear  program  may  not  be 
produced.  The  right  hand  column  of  Table  VIII  provides  the 
number  of  programs  whcs  priority  position  is  lowered  from 
the  constrained  case.  This  column  contains  the  number  of 
programs  which  lost  their  priority  position  because 
(FPVi)  (Xi)  <  (FPVb)  (XI)  ,  where  i  represents  the  program 
under  consideration   and  b  represents  the   program  initially 
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ranked  icmediatly  belcw  the  ith  program.  These  numbers  are 
an  indication  of  the  the  differences  in  selecting  BD1&2 
programs  by  a  linear  programming  solution  rather  than  the 
initial  prioritized  list  produced  in  the  MCDEC  process. 


■ 

TABLE  VIII 

Besult 

s  of 

Formula ti 

on  5. 

2 

with 

MCDEC  Data 

Case 

EE 

Prog 
Full 

ram   Fund 
Part 

ing 
None 

Priority 

FPV 

Chan  ges  in 
Ranking 

A 

0.00 

74 

0 

0 

0 

E 

0.10 

72 

1 

1 

2 

C 

0.  15 

71 

1 

2 

2 

£ 

0.25 

69 

2 

3 

5 

E 

_ 

0.50 

61 

2 

11 

13 

The  results  of  fcrmulation  5.5  with  the  set  cf  MCESC 
process  data  is  showr  in  Table  IX.  These  results  depict  the 
linear  program  solution  fcr  maximizing  the  program's 
Deficiency-Derived  Efficiency  Value  (DDEV)  when  subjected  to 
progressively  restricted  budget  constraints.  The  ncticable 
solution  difference  between  maximizing  DDEV  instead  of  FPV 
is  the  larger  guantity  of  BDTSE  programs  dropped  during  the 
DDEV  budget  reduction  conditions.  The  differences  between 
the  twc  formulation  results  is  due  to  the  lack  of  the 
Subjective  Evaluation  Value  (SEV)  in  the  DDEV  solution. 
Assuming  that  the  IIEV  is  a  more  direct  and  otjective 
measure  cf  F.DTSE  program  accomplishment  of  mission  deficien- 
cies then  in  an  actual  application  the  partially  funded  and 
non-funded   programs   would   be   identified   for    further 
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evaluation  prior  to  selection.  The  right  hand  column  of 
Table  IX  provides  the  number  of  programs  whose  priority 
positicn  lowered  when  comparing  a  ranking  of  (Xi)  (DDEVi)  to 
a  ranking  according  tc  the  vector  DDEV  only. 


TABLE    IX 

Eesult 

s   of    Formulation    5.5 

with 

MCDEC   Data 

Case 

EE 

Program      Fund 
Full        Part 

Ling 
None 

Priorit 
DDEV 

y   Changes    in 
Ranking 

A 

0.00 

74                0 

0 

0 

E 

0.  10 

71                 1 

2 

3 

C 

0.  15 

69                 1 

4 

4 

E 

0.25 

60                 1 

13 

13 

E 


0.50 

50                2 

22 

23 

Formulation  5.6  further  restricted  the  maximization  of 
Sum/i  [  (DDEVi)  (Xi)  ]  by  including  constraints  for  each 
mission  deficiency  in  addition  to  the  budget  constraints. 
Table  X  provides  foriulation  5.6  results  when  using  the  same 
MCDEC  data.  In  this  illustration  the  jth  Deficiency 
Accomplishment  (DAj)  value  is  set  equal  to  a  single  guantity 
for  all  deficiencies.  This  value  for  DA  represents  a  defi- 
ciency accomplishment  goal  which  the  model  user  would  like 
the  portfolio  of  selected  RDTSE  programs  to  achieve.  As 
previously  stated,  this  goal  may  not  be  feasible  with 
currently  considered  programs.  The  variable  Yj  in  foriula- 
tion 5.6  provides  assurance  that  a  feasible  solution  will  be 
obtained,  and  it  provides  identification  of  the  def ici ercies 
that  fail  to  meet  the  user's  goal.     If  Yj  is  egual  to  zero 
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then  the  jth  deficiercy  goal,  BAj,  has  been  met.  If  the  Yj 
value  is  one  then  no  accomplishment  of  the  jth  deficiency  is 
provided  under  the  specified  set  of  constraints.  The  results 
cf  four  cases  are  shewn  in  Table  X.  Four  values  of  DA  are 
used  and  each  DA  case  is  further  subjected  to  five  budget 
reduction  conditions.  For  each  case  shown  in  Table  X  the 
budget  reductions  impose  the  same  F.DTSS  program  selection 
portfclic  as  in  formulation  5.5.  The  two  priority  change 
columns  provide  the  number  cf  programs  that  lower  their 
priority  standing  as  a  result  of  the  linear  programming 
model  reducing  the  funding  proportion  Xi  to  obtain  an 
optima]  solution. 

The  deficiency  accomplishment  columns,  of  Table  X,  show 
the  number  of  deficiencies  that  obtain  the  goal  of  EA  in 
each  case  and  the  numbers  of  deficiencies  partially  and  not 
accomplished.  In  the  fully  funded  cases  all  RDT&E  programs 
are  selected  as  in  the  current  MCDEC  process  and  all  defi- 
ciencies are  at  least  partially  accomplished.  Case  I-A  shows 
that  74  deficiencies  are  greater  than  or  equal  tc  100 
percent  acccmplished  and  84  deficiencies  are  less  than  100 
percent  alleviated.  Case  IV-D  shows  that  at  a  25  percent 
budget  reduction  87  deficiencies  are  accomplished  at  greater 
than  cr  equal  to  85  percent  while  63  deficiencies  are  less 
than  65  percent  alleviated  and  eight  deficiencies  are  not 
accomplished.  For  this  data  set,  these  results  imply  that 
even  when  all  programs  are  fully  funded  many  deficiencies 
are  net  acccmplished  at  the  set  goal  while  others  are  using 
resources  in  excess  cf  that  required  to  meet  the  goal.  For 
the  data  used  in  this  illustration  25  deficiencies  were 
accomplished  at  200  percent  or  greater  and  the  largest 
ever acccirp lishment  was  535  percent.  Numbers  representing 
deficiencies  move  frcm  the  DA  column  to  partial  and  not 
accomplished  columns  as  budget  reductions  were  imposed  that 
reduce   funding   for   programs   that   support   the   specific 
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TABLE 

X 

T 

Result 

s  of 

I< 

:rmula tion 

5.6  with  I 

JCDEC 

Data 

Case 

EA   BR 

Program 
Funding 
Pull  Fart  I 

^'one 

Priority 

Changes 
DDSV   FPV 

Deficiency 

Accomplishment 
DA   Part  None 

Case  I 
A   1.C  .CO 
3       .  10 
C       .  15 

D       .25 

E       .  50 

74 
71 

69 
60 
50 

0 
1 
1 
1 

2 

0 

2 

4 

13 

22 
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3 

4 

13 

23 

0 

3 

5 

14 

24 

74 
74 
73 
70 
61 

84 
83 
84 
82 
87 

0 

•  1 

1 
e 

1  0 

Case  II 
A   .55  .00 
3       .  10 
C       .  15 
D       .25 
E       .  50 

74 
71 

69 
60 
50 

0 
1 
1 
1 

2 

0 

2 

4 

13 

22 

0 

3 

4 

13 

23 

0 

3 

5 

14 

24 

77 
77 
76 
73 
64 

81 
80 
82 
77 
84 

? 

1 

8 
10 

Case  III 

A   .9C  .00 
B       .10 
C       .  15 
D       .25 
E       .50 

74 
71 

69 
60 
50 

0 
1 

1 
1 
2 

0 

2 

4 

13 

22 

0 

3 

4 

13 

23 

0 

3 

5 

14 

24 

39 
38 
37 
33 
76 

69 
69 
70 
67 
72 

0 
1 
1 
c 
10 

Case  IV 

A   .85  . 00 
3       .  10 
C       .  15 
D       .25 
E       .  50 

74 
71 

69 
60 
50 

0 
1 
1 
1 
2 

0 

2 

4 

1  3 

22 

0 

3 

4 

13 

23 

0 

3 

5 

14 

24 

93 
92 
91 
87 
30 

65 
65 

66 
63 
63 

c 
1 
1 

8 
10 

deficiency.  In  all  DA  goal  cases,  one  mission  deficiency  was 
not  acccnp lished  at  any  percent  when  a  budget  reduction  of 
.10  or  .15  was  imposed.  When  the  more  extreme  budget  reduc- 
tions were  imposed  mere  programs  were  not  funded  and  more 
deficiencies  were  not  accomplished.  The  linear  programming 
solution  procedure  concentrates  resources  into  programs  that 
accomplish  deficiencies  with  the  highest  Deficiency  Relative 
Importance  height  (DEItf)  and  does  not  prevent  over  accom- 
plishment in  excess  of  100  percent.  This  allows  an  optiiral 
formulation  to  occur  with  a  portfolio  that  does  not  select 
RDTSE  programs  that  enly  accomplish   deficiencies  with  a  low 
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DSIW.  As  shown  in  case  I-E,  61  deficiencies  were  accom- 
plished at  cr  greater  than  100  percent  while  10  ieficiercies 
were  not  accomplished.  At  some  point  nonaccomplishment  of 
the  less  important  deficiencies  will  outweigh  the  benefit 
from    cveraccomplishment    of    the    more    important    deficiencies. 

The  firal  linear  programing  formulation  proposed  here 
does  net  duplicate  the  MCDEC  process  in  any  obvious  way  but 
concentrates  on  maximizing  the  guantity  of  all  deficiencies 
accomplished.  The  following  formulation  uses  the  previously 
defined  variable  Yj  as  the  deviation  from  the  set  deficiency 
accomplishment  goal.  The  formulation  for  a  goal  of  100 
percent    fellows    as 

minimize      Sum/j   [Yj"  (5.10) 

subject   tc 

Sum/i  [  (Aki)  (Xi)  ]  +  ER  (Bk)  <  Bk 
Sum/i  [  (PPEAji)  (Xi)  ]  +  Yj   >  1.00 
0  <  Xi  <  1 
0  <  Yi  <  1 
i  =  1.  ..  p 
j  =  1...d 
k  =  1...t. 

Formulation  5.10  optimizes  deficiency  accomplishment  by 
minimizing  the  deviation  from  full  deficiency  alleviation. 
Programs  are  restricted  ty  budget  constraints  and  are 
selected  according  tc  the  proportion  of  deficiency  accom- 
plishment they  impart  to  deficiencies  still  below  the  set 
goal.  Table  XI  summarizes  the  results  of  Formulation  5.10 
with  the  MCEEC  process  data  set.  In  general,  fewer  programs 
are  i€guired  to  provide  the  same  mission  deficiency  accom- 
plishment than  when  all  programs  are  fully  funded.  Net  until 
an  extreme  budget  reduction  is  imposed  does  the  guantity  of 
100  percent  or  greater  accomplished  deficiencies  dec:ca:o. 
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61 

60 
58 
53 
31 

5  3 

6  3 

7  9 
6         15 

10         43 

13 

14 
16 
21 
51 

13 
14 
15 

20 
51 

74         3  4 
74         84 
74         34 
74         84 
70         88 

0 
0 
0 
0 
0 

Ey  concentrating  on  the  number  of  deficiencies  accom- 
plished, formulation  5.10  identifies  programs  which  may  not 
be  reguired  even  when  funding  is  available.  The  solution 
values  of  Yj  provide  an  identification  of  the  deficiencies 
that  require  more  BE1&E  program  dedication  to  achieve  full 
accomplishment.  Table  XI  case  A  shows  that  for  the  same 
deficiency  accomplishment  results  as  case  I-A  of  Table  IX 
only  61  programs  recuire  full  funding  and  five  need  or>ly 
partial    funding.  Case   I-A      of    Table      IX    allowed      74    fully 

funded  programs.  This  reduction  in  selected  programs  repre- 
sents an  18.7  percent  total  funding  reduction  over  the  five 
budgeted  years  and  a  9.9  percent  funding  reduction  in  the 
most  restrictive  year.  The  FDTSE  programs  not  funded  in 
Table  XI  represent  those  which  should  be  reevaluated  as  to 
their  extent  of  deficiency  accomplishment  prior  to  selec- 
tion. If  these  programs  are  not  selected  this  may  lead  to 
the  recovery  of  resources  to  provide  greater  accomplishment 
cf    the    partially   alleviated    deficiencies. 

Unless  the  values  of  DDEV  and  FPV  are  used,  formulation 
5.10  does  not  provide  a  means  to  completly  prioritize  a 
listing    cf    EDTSE    programs.  Formulation    5. 10    does    separate 

the       programs      into      the    three      funding      classifications      of 
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fully,  partially,  and  not  funded.  If  a  prioritization  is 
required,  fully  fur.ied  programs  would  logically  form  the 
highest  priority  and  the  not  funded  programs  would  forir  the 
lowest  priority  classification  set.  The  partially  funded 
programs  would  form  the  middle  priority  set  of  programs  and 
could  te  further  ranked  within  this  set  according  to  their 
respective  funding  proportion  Xi . 

C.   DISCISSION 

I  wo  general  appioachs  to  the  MCT£C  prioritization 
process  using  linear  programming  have  bee.,  proposed.  ~ ..  t 
first  arproach  demonstrated  in  formulations  b.1,  5.2,  5.4, 
5.5,  and  5.6  maximized  the  MCDEC  process  values  concerning 
RDTSE  program  relationships  to  mission  deficiency  accom- 
plishment. Each  of  these  formulations  have  an  unconstrained 
case  where  they  duplicate  the  currently  proposed  Y.CIEC 
process.  Formulation  5.10  represents  a  second  method  to 
approach  the  MCDEC  process  through  concentration  en  the 
quantity  of  deficiencies  accomplished  and  selecting  programs 
as  needed  to  obtain  an  accomplishment  goal.  These  approaches 
and  formulations  illustrate  the  feasibility  and  flexibility 
of  the  linear  programming  portfolio  selection  molei  as 
applied  to  the  MCDEC  process.  The  results  listed  in  Zarles  X 
and  XI  show  that  for  small  budget  reductions  both  approaches 
select  programs  that  provide  similar  quantities  of  deficien- 
cies accomplished  tut  formulation  5.10  provides  i  less 
costly  alternative  to  achieve  these  deficiencies. 

Tc  accept  the  results  of  any  linear  programming  .  • ,  croach 
a  major  assumption  lust  be  accepted.  Linear  progra&ming 
assumes  that  the  relationships  of  coefficients  and  variables 
used  in  the  formulation  are  linear  or,  at  least,  that  linear 
functions  satisfactorily  approximate  the  actual  relation- 
ships.   Intuitively,    and   as   presented   in   some  of   the 


71 


literature,  these  interrelationships  between  3DT£ E  programs/ 
resource  expenditures,  and  benefits  may  not  be  linear  but 
instead  may  be  seme  ether  functional  form.  The  linear  func- 
tions, however,  do  provide  an  approximation  to  the  actual 
situation  which  is  u rderstardable.  The  proposed  formulations 
are  possibilities  which  can  serve  as  program  selection  tools 
and  net  as  decision  lakers  in  and  of  themselves. 

Tc  further  investigate  the  linearity  assumptions,  the 
relationships  of  the  several  individual  coefficients  and  the 
two  proportional  variables  should  be  discussed.  The  vari- 
ables Xi  and  Yj  which  represent  proportional  values  can  both 
be  readily  accepted  if  their  respective  coefficients  are 
proportionally  divisible.  In  the  proposed  formulations,  the 
budget  constraints  used  the  quantity  [  (Aki)  (Xi)  ]  tc  define 
the  budget  allocation  to  the  ith  program  in  the  kth  time 
period.  The  linear  assumption  maintains  that  a  program 
funded  at  a  proportional  amount  less  than  one  will  yield  the 
same  proportional  benefit.  In  actual  applications  the 
linearity  assumption  may  not  re  appropriate  throughout  the 
entire  range  of  Xi  from  zero  to  one.  Some  programs  iray 
require  a  proportional  funding  lower  limit  greater  than  zero 
to  remain  a  viable  fET&E  program.  For  this  condition  the 
ith  program  which  requires  a  minimum  funding  level  could 
have  the  respective  funding  proportion  variable  Xi  defined 
at  zero  and  over  a  range  from  the  minimum  funding  proportion 
to  one.  Another  condition  may.  require  either  full  or  no 
funding.  This  condition  could  be  achieved  by  defining  the 
variable  Xi  at  the  integer  values  of  zero  and  one  only  and 
utilizing  integer  programming  computations  to  find  the 
optiial  program  selection. 

A  sinilar  discussion  as  presented  for  the  budget  coeffi- 
cient, Aki,  can  lead  to  acceptance  of  the  linear  assumptiens 
concerning  the  coefficients  FPVi,  DDEVi,  and  PPDAji  as  they 
are  proportionally  reduced  by  the  variable  Xi.   First,  these 


coefficients  must  be  accepted  themselves  as  values  capable 
of  retaining  their  benefit  measurement  properties  during 
linear  programming  ccirputat ions.  Stevens  [Eef-  26]  proposed 
the  four  measurement  scales  of  nominal,  ordinal,  interval, 
and  ratic  which  are  helpful  to  discuss  the  properties  of 
these  coefficients. 

Briefly,  nominal  scale  measurements  represent  numerical 
identification  f cr  an  item  or  event  such  as  an  autc  license 
plate  number  and  does  not  have  any  mathematical  properties 
associated  with  it.  Ordinal  scale  values  measure  rank 
ordering  only  such  as  the  priority  numbers  of  1  through  74 
given  tc  the  EDT&E  programs  as  a  result  of  the  MCEEC 
process.  Interval  and  ratio  scales  maintain  a  comparative 
worth  between  values.  The  interval  scale  has  an  established 
interval  unit  and  each  specific  value  is  measured  by  the 
number  of  these  units  that  separate  it  from  other  measure- 
ment values  above  or  below  it  en  the  scale.  A  natural  origin 
is  net  always  established  in  an  interval  scale  even  if  a 
zero  value  exists.  The  zero  values  on  interval  scales  are 
assigned  to  arbitrary  points  such  as  on  the  Celsius  or 
Fahrenheit  temperature  scales.  Ratio  scales  have  a  natural 
crigin  in  addition  tc  the  properties  of  the  interval  scales. 
Ratio  scales  are  capable  of  proportional  comparisons  cf  the 
numerical  values  such  as  stating  a  program  which  ccsts  two 
million  dollars  is  twice  as  expensive  as  a  one  million 
dollar  piogram.  To  maintain  the  same  measurement  properties, 
ratio  scales  can  withstand  multiplicative  transformations 
only.  linear  transformations  can  result  in  other  ratio 
scales,  however,  the  new  values  will  be  measures  cf  a 
different  attribute  than  the  first. 

In  linear  equations,  values  with  at  least  interval  scale 
properties  are  necessary.  In  linear  programming,  however, 
the  coefficients  require  the  additional  properties  of  ratio 
scale   measurements  tc   withstand  the   ratio  comparisons  of 
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coefficients  and  right  hand  side  values.  In  Chapter  IV, 
FPDAji  is  defined  as  a  straightforward  estimate  of  the  ith 
program's  proportion  of  the  jth  deficiency  accomplishment. 
If  these  estimates  are  accurate,  the  coefficient  PPDAji  can 
he  acceptable  as  a  measurement  on  a  ratio  scale.  The  DDIVi 
coefficient  is  a  summation  of  individual  proportional  trans- 
formations cf  each  E-FEAji  based  on  the  Deficiency  Felative 
Importance  Height  for  the  jth  deficiency  (DEISj) .  The  DDEVi 
can  he  accepted  as  a  different  ratio  scale  measurement  by 
accepting  as  valid  the  multi-attribute  utility  analysis 
which  is  used  to  derive  the  DEIWj .  The  FPVi  is  a  linear 
functicn  of  DDEVi  and  a  Delphi  process-based  Subjective 
Evaluation  Value  {SEVi).  DDEVi  and  SEVi  are  both  adjusted  by 
the  confidence  factors  of  the  Deficiency  Derived  List  Weight 
(DDLW)  and  the  ith  program's  Subjective  Evaluation  List 
Feight  (SEIWi) ,  respectively.  Although  not  specifically 
stated  by  Creed,  [Ref.  25],  all  DDEVi  in  the  sample  KCEEC 
data  set  were  adjusted  by  a  common  DDLW  while  e^ch  SFVi  was 
adjusted  by  its  specific  SELWi.  Accepting  FPVi  as  a 
different  ratio  measurement  of  RDTSS  program  benefit 
requires  accepting  (SEVi)  (SELWi)  added  to  (DDEVi)  (DELW)  . 
Although  both  FPVi  and  DDEVi  might  be  accepted  as  ratio 
scale  measurements  of  EDTSE  program  benefit,  because  of  the 
functional  change  between  them,  they  do  not  measure  the  same 
attributes  cf  the  ith  program.  The  vector  (SEV)  (SELW)  also 
does  not  represent  the  same  qualities  as  the  vector  SEV 
because  cf  the  evident  change  of  SELWi  according  to  each 
program. 

The  WCDEC  prioritization  process  proposed  only  the  FPVi 
to  represent  the  firal  relative  worth  of  FDT5E  programs  in 
the  accomplishment  of  mission  deficiencies.  If  tais  value  is 
acceptable  then  formulations  5.2  and  5.1  provide  examples  of 
linear  programming  pcrtfolio  selection  models  which  will 
maintain  an  optimal  program  selection  portfolio  under  budget 
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resource  reductions.  If  the  subjective  evaluation  addition 
included  in  the  FPVi  definition  is  not  acceptable  then  the 
multi-attribute  analysis  of  individual  deficiency  importance 
can  be  included  by  naximizing  Sum/i  [  (DDEVi)  (Xi)  ]  as  in 
formulations  5.5  and  5-6.  These  formulations  allow  program 
selection  solutions  under  budget  reductions  which  may  net  be 
obtained  through  priority  listings  only.  The  last  formula- 
tion approach,  which  does  not  directly  represent  the 
currently  proposed  MCEEC  process,  appears  to  be  a  favorable 
EBTSE  program  selection  model  as  shown  from  the  example  data 
set.  Fcmulation  5.10  provides  identification  of  programs 
requiring  reevaluaticn,  deficiencies  requiring  dedicated 
programs,  and  a  selection  of  programs  that  accomplish  the 
maximum  deficiency  alleviation.  It  should  be  noted  that  in 
all  the  proposed  linear  program  formulations  the  solutions 
are  optimal  computations  of  the  benefit  and  coefficient  data 
provided  and  can  only  be  given  the  confidence  inherent  in 
the    data    themselves. 
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VI.    CONCLUSIONS 

A.       EISUITS 

This  thesis  has  investigated  the  MCDEC  Prioritization 
Process.  .This  process  was  produced  by  the  Development 
Center,  FCDEC,  to  establish  the  relative  importance  of  EDTSE 
programs  prior  to  Marine  Corps  input  to  the  EDTSE, N  PCM.  An 
investigation  of  the  literature  showed  that  the  MCDEC 
process  can  be  classified  with  similar  benefit  measurement 
models  currently  accepted  by  industry.  The  literature  also 
identified  ether  propesed  and  accepted  EDTSE  program  selec- 
tion models,  classified  as  portfolio  selection  models,  which 
showed  possible  advantages  that  could  enhance  the  proposed 
MCDEC  process.  Several  MCDEC  process  linear  programming 
model  modifications  were  presented  and  showed  the  portfolio 
selection  model  advantages  of  maximizing  the  benefit  func- 
tion   when    subjected    tc   resource    constraints. 

The  feasibility  cf  representing  the  MCDEC  process  as  a 
linear  programming  portfolio  selection  model  was  illus- 
trated. These  illustrations  raised  the  possibility  that  the 
Final  Program  Value  assigned  in  the  process  might  not  be  the 
test  measurement  of  BETSE  program  mission  deficiency  accom- 
plishment. Another  linear  programming  model  approach  to 
selecting  the  RDTSE  programs,  represented  by  the  example 
data,  was  also  illustrated  and  provided  an  economical  alter- 
native   for    maximizing    deficiency    accomplishment. 

Currently  a  mathematical  analysis  support  model  is  used 
as  a  tccl  in  the  Procurement  Marine  Corps  PCM  process  but 
not  in  the  development  of  the  Marine  Corps  portion  of  the 
RDT5E,Navy      EOM.  According    to      the      literature,         industry 

accepts    the    use    of    subjective      input    with    analytic    tools    for 
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RDTSE  program  selecticn  duplications.  The  MCDEC  process  as 
it  stands  or  with  the  portfolio  selection  enhancements  has  a 
base  to  assist  as  an  analytic  tool  for  the  Marine  Corps 
responsibilities  in  the  RDTSE,  N  PCM  process. 

E.   EOJTEER  INVESTIGATIONS 

Several  areas  of  further  study  and  research  are  evident 
from  this  investigation.  The  variety  of  program  selection 
models  proposed  in  the  literature  each  have  advantages  and 
disadvantages  which  require  further  investigation  as  to 
their  possible  application  to  the  Marine  Corps  RDTSE  program 
selection  process.  The  data  gathering  and  compiling  tech- 
niques of  these  additional  models  require  study  as  well  as  a 
complete  analysis  of  the  data  and  process  results  from  a 
complete  trial  MCDEC  process  run.  The  most  difficult  further 
research  will  be  to  estimate  the  model  costs  and  perform  a 
cost  benefit  analysis  of  implementing  a  RDTSE  program  selec- 
tion model  process. 

The  literature  review  chapter  presented  model  evaluation 
criteria  ard  limitations  suggested  for  industrial  PSD 
program  selecticn  models.-  Further  research  is  required 
into  the  applications  of  these  or  similar  criteria  and  limi- 
tations in  the  context  of  Marine  Corps  applications  specifi- 
cally. The  extent  of  industrial  model  applications  to  the 
Marine  Corps  will  be  limited  because  of  the  non-jrofit 
orientation  of  defense.  However,  the  other  portfolio  selec- 
tion models  reviewed  in  the  literature  may  provide  valuable 
alternatives  to  the  presented  MCDEC  linear  programming 
model. 

Subjective  evaluation  of  RDTSE  programs  was  seen 
accepted  as  a  necessity  in  the  literature  and  was  seen 
proposed  for  use  in  the  MCDEC  process.  The  manipulation  of 
the  subjective  data  by  the   MCDEC  process  was  discussed  here 


77 


in  context  cf  measurement  scale  properties.  Further  investi- 
gation into  the  subjective  values  and  their  true  measure- 
ments is  needed.  Saaty  [Eef-  24]  and  Lindsay  [Ref.  27]  have 
proposed  different  methods  of  combining  subjective  judge- 
ments into  quantities  that  maintain  measurement  scale  prop- 
erties. Further  investigation  into  these  or  other  subjective 
judgement  methods  may  provide  more  acceptable  alternatives 
than  the  Delphi  and  value  manipulation  methods  currently 
proposed . 

Formulation  5.4  illustrated  the  possible  resource  allo- 
cation advantages  from  assigning  a  proportional  program 
funding  variable  to  each  year  in  the  planning  horizon.  Ihe 
benefit  received  from  the  programs,  however,  may  also  change 
ever  time.  Further  study  is  necessary  to  investigate  the 
program  benefit  measurement  values  used  in  the  portfolio 
selection  models  and  how  these  values  change  over  time. 
Additional  variables  and  benefit  coefficients  necessary  to 
describe  each  time  period  will  increase  the  computer  storage 
and  computational  requirements  and  this  increase  will  also 
need  investigation. 

The  costs  and  benefits  cf  implementing  tn e  proposed 
process  also  reguires  further  study.  The  current  process 
software  was  developed  for  a  Tectronix  4054  minicomputer 
and  is  net  compatible  on  other  systems.  Resources  in  terms 
cf  manhours  and  money  will  be  reguired  to  upgrade  or  repro- 
gram  process  software  to  ensure  compatibility  with  raircccm- 
puter  systems  currently  at  HQMC  and  the  Development  Center. 
The  presented  linear  programming  computations  utilized  a 
Ketrcr.,  Inc.  MPSIII  Dataform  package  as  run  on  an  IBM  3033 
computer.  Further  investigation  into  microcomputer  linear 
programing  software  is  necessary  and  represents  additional 
costs.  If  large  linear  programing  packages  are  reguired  to 
enhance  the  process  additional  mainframe  usage  will  add 
costs.    Gathering  the  subjective   data  from  operational  and 
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non-cperaticnal  units  during  the  MCDEC  process  survey  anal- 
ysis represents  manpower  and  TAD  costs  not  currently 
required.  The  total  monetary  benefits  are  possitly  the 
hardest  to  classify  ci  estimate.  The  value  of  valid  informa- 
tion concerning  new  defense  systems  and  programs  as  they 
affect  the  nissicn  accomplishment  of  the  Marine  Corps  will 
need    further  research    to    quantify. 
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APPENDIX  A 
MCDEC  PRIORITIZATION  PROCESS 

This  appendix  displays  the  organizational  structure  for 
the  Development  Center,  Deputy  Chief  of  Staff  for 
Developmental  Coordination,  Prioritization  Working  Group; 
and  Chief  cf  Staff's  Prioritization  Committee  in  Figures 
A.1,  A. 2,  A. 3,  and  A. 4  respectively.  The  remainder  cf  the 
appendix  details  the  chases  and  tasks  of  the  1CDEC  prioriti- 
zation process  and  lists  the  specific  Development  Center 
agency  responsible  fcr  completing  eacn  step.  The  purposes 
for  each  following  tasks  are  cuoted  from  Creed  [Ref.  25]. 
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Ehase    I:  Determine    deficiencies   and   requirements/ 

lask    1.    Preparation   of    plans 

Dates:    1    January    to    28    February 

Agency:    Planning    and    Evaluation    Branch 

Purpose:  To  provide  an  approved  basis,  via  guidance 
and  direction  set  forth  in  Marine  Corps  plans,  for 
subsequent  Mission  Area  Analyses,  by  updating 
and/cr  revisicn  of  basic  Marine  Corps  planning 
dccunents   -    i.e.,    MMECP    and    MLfiP. 

lasX    2.    Survey    Aralyses 

Dates:    1    January    to    30    March 

Agency:    Analysis    Support    Branch 

Purpose:  Tc   gather      opinion    input      from    FMF  and 

other  appropriate      ccmmands/agencies   regarding  the 

ef  f  ective  r.ess  cf  ongoing  projects  in  the  ESC 
program    and    tc   solicit    new    program    ideas. 

lask    3.    Mission    Area  Analyses 
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Dates:    1    March    to   30    April 

Agency:    Planning    and    Evaluation    Branch 

Purpose:  To  provide  the  basis  for  justification  of 
RSE  projects  via  specified  Marine  Corps  deficien- 
cies  resulting   from    Mission   Area    Analysis. 


B.         Phase    II:         Pricritize    deficiencies    and   requirements, 
lask    1.    Mission    Area   Analysis   Results    Eriefings 

Dates:    1    May    tc    15   May 

Agency:    Plannirg    and    Evaluation   Branch 

Purpcse:  Tc  provide      the   Prioritization      Working 

Group         (PRWG)  with      Mission         Area         Element  (s) 

deficiencies-oriented  briefings  in  preparation  for 
the    PRWG    MAA    prioritizations    [?^ase    II   Task    2). 

Task    2.    Survey    Analysis    Results    Briefings 

Dates:    1    May    tc    15   May 

Agency:    Analysis    Support    Eranch 

Purpcse:  Tc   provide      the    Prioritization       Working 

Group  (PRWG)  with  FME/major  command  and  agency 
derived  input  obtained  during  Phase  I,  concerning 
deficiencies. 

lask    3.    Design    of   the    Deficiency    decision   tree 

Dates:    15    May    tc    15    July 

Agency:    Prioritization    Working    Group    (PRW3) 

Purpose:  To  analytically  derive,  vis  irulti- 
attribute  utility  analysis,  a  consolidated  rank- 
ordering  af  all  Mission  Area  (element)  deficiencies 
and  an  associated  relative  importance  weight  of 
each. 


C.         Phase    III:  Prioritize    F&D   programs, 

lask    1.    Program    Project   briefings 
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Dates:    15   Jul}-   to    15    August 

Agency:  Division  DPC's  (scheduled  by  Operations 
Eiancn) 

Purpose;  To  provide  preparatory  information  to  the 
E ricritizaticn  Working  Group  and  Chief  of  Staff's 
Committee  for  consideration  in  subseguent  prioriti- 
zation  deliberations. 


Task   2.    Survey    Analysis   Results    Briefing 

Dates:    15    Julv   to   15    August 

Agency:    Analysis    Support    Branch 

Purpose:  To        provide      preparatory        information 

derived  from  IMF/major  commands  or  agencies  to  the 
Prioritization  Working  Group  and  Chief  of  Staff's 
Committee  for  consideration  in  subsequent  prioriti- 
zation  deliberations. 

Task      3.         Subjective      Prioritization      of      F.SD      Program 
Projects 

Dates:    15   August   to    1    October 

Agency:    Analysis    Support    Branch 

Purpose:  To  obtain  a  subjective  prioritization  of 
BSD  Projects  with  associated  weighted  values  of 
each   reflecting   relative   worth. 

Task      U.         Deficiency-Derived        Prioritization      cf      PSD 
Ere jec ts 

Dates:    15    August    to    1    October 

Agency:    Prioritization    Working    Group    (PRWG) 


Purpose:      To    obtain    a  prioritization   of   R&D    program 

projects      ranked      and  weighted      according      to      that 

project's      capability  to        overcome      Mission      Area 
Element    deficiencies. 


Task    5.    Final    Prioritization   of    RSD    projects 

Dates:    1    October   to    15   October 

Agency:    Prioritization    Working    Group    (PRWG) 
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Purpose:  To  obtain  a  final  prioritization  of  ESC 
program  projects  frcm  the  sac jective-derived  list 
and  deficiency-derived  list  coaDined. 


Task  6.  Director  Development  Center,  Decision  Brief  for 
Action 

Dates:  15  October  to  31  October 

Agency:  As  Directed 

Purpose:   To   present  the   recommended  R&D   program 
project  priority  for  decision. 


D.    Ehase  IV:    Complete  MCEEC  E  &   D  programs  list  in  HQMC 
POM. 

Task  1.  Application  of  funding  profiles 

Dates:  1  Noveater  to  31  December 

Agency:  Operations  Branch 

Purpose:  To  determine  recommended  funding  profiles 
to  reflect  the  desired  prioritization  of  ESC 
Program  Projects. 
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